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1)  Select  an  optimum  sequence  of  screens  for  a fixed  dollar 
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face  of  a fixed  desired  reliability  improvement^ 

iii)  Provide  quantitative  relationships  for  performing  screening/ 
debugging  tradeoffs. 
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test  strengths  and  test  costs.  The  model  includes  four  assembly  levels, 
five  types  of  screens  (temperature  cycling,  constant  temperature,  vibration 
constant  power  and  power  cycling),  provides  for  introduction  of  defects  at 
each  assembly  level  and  includes  the  rework  cycle. 
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EVALUATION 


1.  The  objective  of  this  study  was  to  develop  techniques  which  permit 
cost/effectiveness  trade-off  analyses  among  various  screening  test 
approaches  that  may  be  used  during  the  development  and  production  of 
electronic  equipment. 

2.  The  objectives  have  been  satisfactorily  achieved.  A computerized 
optimization  model  was  developed  for  use  as  a decision  tool  in  selecting 
the  most  cost-effective  test  sequence  from  among  the  many  possible 
alternatives  that  are  presented  in  a given  program.  Although  the  model 
is  rather  complex,  the  computer  program  allows  for  optional  user  input 
and  relative  ease  in  performing  sensitivity  and  trade-off  analyses. 

3.  Use  of  the  model  is  recommended  as  an  aid  in  selecting  optimum  test 
sequences  in  terms  of  minimum  expected  test  and  rework  costs  and  maximum 
screening  effectiveness.  In  addition,  users  of  the  model  are  encouraged 
to  provide  feedback  information  which  will  oermit  further  refinements  in 
the  model  structure,  input  parameters  and  application  procedures. 

EUGEjfE  FIORENTINO 

R&M  Engineering  Techniques  Section 
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SECTION  0.  0 - INTRODUCTION 


One  of  the  key  ideas  developed  in  reliability  engineering  is  the  realization  that 
electronic  parts,  cards,  assemblies,  equipments  and  systems  contain  defects,  due  to 
a variety  of  causes  such  as  poor  parts,  design  errors  and  manufacturing  errors  among 
others,  which  are  not  readily  detectable  by  the  usual  electrical  tests  of  functional  per- 
formance. Moreover,  the  later  in  system  development  and  system  use  that  the  defects 
are  uncovered  the  more  costly  the  discovery  becomes.  Of  course  this  last  statement 
must  be  balanced  by  the  fact  the  removal  of  all  defects  at  one  level  (e.  g. , parts)  does 
not  guarantee  no  defects  at  the  next  (e.g. , card)  level  because  in  each  step  of  the  as- 
sembly process  new  defect  causes  are  introduced. 

It  is  now  a truism  that  by  subjecting  parts,  cards,  assemblies,  equipments  and 
systems  to  extremes  of  environment  such  as  temperature  or  vibration,  these  pre- 
viously mentioned  undetectable  (by  common  means)  defects  can  be  degraded  to  a de- 
tectable level  and  with  an  appropriate  test  setup  can  be  detected  and  eliminated.  These 
kinds  of  tests  with  the  purpose  of  eliminating  undetectable  or  latent  defects  are  gener- 
ally called  screening  or  debugging  (SD)  tests. 

Unfortunately  there  are  a large  number  of  possible  tests  that  can  be  run  in  any 
particular  situation  and  the  methodology  for  selecting  an  optimum  sequence  of  tests  is 
not  well  developed:  irrespective  of  whether  one's  standard  of  methodology  is  good 
applied  science  or  even  good  engineering. 

The  purpose  of  this  present  study  is  to  develop  a computerized  screening  and 
debugging  optimization  (SDO)  model  which  Includes  test  strength  (TS)  and  test  costs 
among  the  primary  variables  and  which  can  be  used  to  solve  three  problems: 

1)  For  a fixed  dollar  amount  available  what  is  the  optimum  sequence  of  screens 
which  yields  the  hi^iest  final  MTBF,  0^. 

2)  In  the  face  of  an  initial  MTBF,  0t  and  a 0p  requirement  determine  tlie  se- 
quence of  screens  which  moves  the  "system"  from  0j  to  0p,  0i  <0p,  at 
least  c ost. 

3)  For  a fixed  sequence  of  screens,  determine  the  cost  and  the  test  strength. 

In  order  to  solve  these  problems  it  was  necessary  to: 

1)  Perform  a literature  search  to  determine  what  types  of  screens  are  useful 
and  feasible. 

2)  Build  a data  base  in  order  to  compute  test  strengths  (TS)  and  test  costs. 

3)  Find  a way  of  converting  MTBF  to  defects. 

4)  Construct  a flexible,  useful  computerized  model  which  truly  reflects  the 
process  of  and  cost  of  removing  defects  from  a system  at  its  various  stages 
or  levels  of  assembly. 

The  balance  of  this  report  discusses  how  these  four  tasks  were  accomplished 
and  what  results  were  achieved. 
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SECTION  1.0 -SUMMARY  OF  RESULTS 


The  basic  result  of  the  study  is  the  model  itself.  It  is  a fairly  sophisticated 
model  yet,  hopefully,  it  will  be  useful.  Its  utility  derives  partly  from  the  fact  that  it 
is  a faithful  representation  of  the  screening  process:  it  includes  rework  cycles,  test 
strengths,  test  cost  models,  allow?  for  introduction  of  defects  when  a new  level  of 
assembly  is  reached  and  accommodates  imperfect  rework  at  the  card  and  assembly 
levels.  It  includes  four  levels  of  assembly;  card,  unit,  equipment  and  system.  The 
reasons  for  omitting  the  part  level  are  thoroughly  discussed  in  Section  3.3.  It  accom- 
modates temperature  cycling,  constant  temperature,  vibration,  constant  power  and 
cycled  power  screens. 

Perhaps  the  key  feature  of  the  model  is  that  practically  all  the  required  input 
variables  are  already  included  in  the  model  as  fall -back  options.  That  is,  if  the  user 
has  better  information  for  some  variables  he  can  enter  it;  otherwise  the  model  uses 
what  we  have  put  in  it.  The  model  is  described  in  considerable  detail  in  Section  5,0, 
However,  the  accompan5dng  Table  1,1  gives  a good  idea  of  the  parameters  needed  in 
the  model  and  how  the  fall-back  option  is  implemented. 

There  are  three  major  test  characteristics;  test  costs,  screening  strength  and 
detection  probability.  The  equations  yielding  screening  strength  (SS)  are  incorporated 
in  the  model.  No  fall-back  option  is  pro^nded.  If  the  user  desires  to  change  the  SS 
equations  the  model  should  be  changed.  Because  the  fixed  costs  of  test  are  so  highly 
user  dependent  (e.g. , how  is  the  test  equipment  bhing  amortized)  this  variable  is  a 
user  input  with  a zero  fall-back  option.  The  variabld  test  costs  are  also  a user  input 
with  functions  provided  in  the  model  as  a fall-back  optiori;-'.,Detection  probability  is 
also  a user  input  with  a fail-back  option  of  0, 75, 

For  the  manufacturing  data  required  all  inputs  are  user  inputs  Mtli  the  excep- 
tion of  the  fixed  portion  of  rework  cost.  This  cost  is  programmed  as  a fuhction  of 
variable  costs  and  no  fall-back  option  is  provided, 

The  program  data  portion  of  the  input  parameters  consists  of  all  user  inputs 
with  fail-back  options  provided  for  each  parameter.  Here  "tolerance"  is  necessary 
to  decide  when  a solution  has  been  reached. 

The  output  reports  consist  of  the  optional  test  sequence,  including  test  para- 
meters (e.g,  14  temperature  cycles)  total  cost  broken  down  by  level  and  by  test  and 
the  total  TS, 
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TABLE  1.1,  Input  Data  Re^uirements/OptionB  for  SDO  Model 
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TABLB  1. 1.  Input  Data  llequiremcnts/Optioiis  and  Output  Report  for  SDO  Model  (Cont) 


- Input  Data  Summarized 

- Output  Report 


• Optimal  I'crt  Sclcetion 

• Test  Parameter  Values 

• Total  Cost  by  Level  by  'test 

• Total  Test  Strength 


Test  Sequence 


Parameter  Value 


No.  1 No.  2 No.  3 No.  4 


Cost 


SECTION  2. 0 - DATA  SOURCES 


2.1  Literature  Survey 

The  literature  survey  was  conducted  in  order  to  ascertain  state-of-the-art  popu- 
lar screens,  costs,  and  test  strengths.  Little  data  was  obtained  for  the  varia- 
bles test  costs  and  test  strengths  because  the  data  available  was  stated  In  qual- 
itative rather  than  quantitative  terms. 

The  literature  survey  itself  conr’sted  of  obtaining  literature  searches  from  the 
Hu^es  library.  National  Aeronautics  and  Space  Administration  Scientific  and 
Technical  Information  facilities,  and  the  Department  of  Defense  Documentation 
Center.  Articles  thou^t  to  be  applicable  to  the  study  were  reviewed  and  further 
segregated  by  their  relevancy.  The  final  results  yielded  approximately  fifty  (50) 
articles/reports  of  particular  relevance  to  this  study.  A complete  listing  of  the 
references  and  bibliography  can  be  found  in  Section  8. 0. 

Several  reports  were  detailed  enou^,  i.  e. , references  51  and  52,  to  be  incor- 
porated into  the  study's  main  data  base. 

Other  reports  suggested  guidelines  to  follow  for  specific  screening  procedures. 
For  example,  reference  8 supplied  the  following  proposed  guidelines  for  temper- 
ature cycling  acceptance  testing  of  electronic  assemblies: 

Type  of  Equipment  No.  of  Temperature  Cycles 


Simple  (100  electronic  parts)  1 

Moderately  complex  (500  electronic  parts)  3 

Complex  (2000  electronic  parts)  6 

Very  complex  (4000  electronic  parts)  10 


Temperature  Range 

The  suggested  range  is  -65°F  to  ISl^F,  or  as  a minimum,  a temperature 
range  of  at  least  lOO^F  is  recommended. 

Temperature  Rate  of  Change 

The  rate  of  change  of  internal  parts  should  fall  within  1°F  and  40°  F per 
minute.  The  hi^er  rates  provide  the  best  screening. 

Temperature  Soak  Times 


The  next  temperature  ramp  may  be  started  when  the  internal  parts  have 
stabilized  within  S^F  of  the  specified  temperature  and  the  functional  checks 
have  been  completed. 

Equipment  Operation 


Equipment  should  be  energized  and  operated  during  temperature  cycling, 
except  the  equipment  should  be  turned  off  during  chamber  cool-down  to 
permit  internal  parts  to  become  cold. 
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Equipment  Monitoring 

While  it  is  desirable  to  continuously  monitor  the  equipment  during  the  tem- 
perature cycling,  cost  considerations  may  dictate  otherwise.  In  such  cases, 
periodic  checks  plus  close  monitoring  of  the  final  cycles  is  appropriate. 

Failure  Criteria 

The  last  cycle  shall  be  failure  free.  Each  repair  should  be  reviewed  for  the 
possibilities  of  introducing  new  defects  into  the  hardware  and  additional  tem- 
perature cycles  added  when  appropriate.  If  repairs  are  complex  or  difficult 
to  make  and  inspect,  or  many  unscreened  parts  are  used  as  replacements, 
additional  cycles  should  be  implemented  as  appropriate  to  the  individual 
case. 

Reference  51  gives  a hypothetical  circuit  card  screening  program  as  follows, 
based  on  its  exjDeriments  with  a single  card  type; 

Rated  power  would  be  applied  to  the  cards  while  they  were  thermally  cycled 
between  temperature  extremes  at  a rate  of  ±20°C/min.  Tlie  temperature 
profile  would  be  sawtooth  (i.e. , no  dwell).  Power  would  not  be  cycled  and 
the  cards  would  not  be  vibrated.  The  temperature  rate  chosen  (20°C/min) 
would  cause  the  least  solder-cracldng  while  permitting  completion  of  screen- 
ing in  the  fastest  possible  time.  Tlie  number  of  temperature  cycles  chosen 
would  depend  upon  the  estimated  number  of  quality  and  reliability  failures 
contained  in  die  population,  and  the  subsequent  reliability  requirement. 

Reference  24  drew  the  following  conclusions  concerning  the  relationships  between 
screens  and  field  reliability. 

• Tliose  items  that  liad  the  more  effective  burn-in  testing  on  production  units 
tended  to  have  the  better  reliability  agreement.  This  indicates  the  necessity 
for  adequately  specifying  a production  unit  burn-in  both  in  duration  and  in 
environmental  exposure. 

• Relationships  were  found  between  reliability  differences  and  several  temper- 
ature related  measures  for  ambient  cooled  WRA's,  including: 

- minimum  ambient  temperature 

- operating  time  at  low  temperature 

- maximum  ambient  temperature 

— temperature  rate  of  change 

indicating  that  the  current  IvnL-STD-781  tests  of  only  requiring  dwells  at  the 
temperature  extremes  with  moderate  rates  of  change  between  the  limits  is 
not  an  adquate  test.  No  provisions  exist  for  evaluating  the  item  under  condi- 
tions of  rapid  and  frequent  temperature  cj^cling. 

• Tlie  significant  relationships  between  vibration  measures  and  reliability 
differences  included: 

— level 

— duration 
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indicating  that  the  MIL-STD-781  vibration  test  of  requiring  10  minutes  of 
sinusoidal  vibration  each  hour  at  one  non-re  sonant  frequency  between  20-60  Hz 
is  not  representative  of  the  field  environment.  The  test  article  is  never  ex- 
posed to  those  frequencies  occurring  in  the  field,  that  produce  failures.  The 
vibration  test  duration  was  found  to  be  a poor  representation  of  the  accummu- 
lated  field  vibration  time.  The  lack  of  reliability  agreement  was  more  pro- 
nounced in  WRA's  installed  in  jet  aircraft  where  the  field  environment  is 
random. 

The  majority  of  the  articles  dealt  in  generalities  concerning  screen  effectiveness. 
The  screens  discussed  varied,  but  could  be  classified  into  operating,  environ- 
mental, e.  g. , tenyierature,  vibration,  and  a combination  of  the  two.  The  con- 
clusions and  experiences  of  the  articles  were  used  accordingly  in  the  develop- 
ment of  the  concepts  utilized  in  this  report. 

General  conclusions  can  be  ejqDressed  in  the  words  of  Reference  1:  "The  one 
central  theme  that  emerges  ...  is  that  opinions  and  case  histories  vary  widely 
within  and  between  the  product  lines  . . .". 

. A summary  of  the  literature  search  can  be  found  in  the  following  section. 

2.  2 Summary  of  the  Results  of  the  Literature  Survey 

At  the  outset  we  must  distinguish  between  accelerated  tests  in  general  and  the 
screening/debugging  tests  of  interest  in  this  present  study.  Generally,  acceler- 
ated tests  have  as  their  purpose  the  extrapolation  of  some  reliability  measure 
"back"  from  accelerated  conditions  to  normal  conditions,  the  motivation  being 
that  testing  at  normal  conditions  takes  too  long  to  provide  statistically  reliable 
estimates  of  whatevei  measure  of  reliability  is  selected.  The  purpose  of  screen- 
ing and  debugging  test;;  is  the  elimination  of  (previously)  undetectable  defects. 

As  previously  indicated  the  purpose  of  this  present  study  is  to  create  a model 
with  which  to  optimize  the  screens  used.  For  this  reason  the  key  issues  for 
any  particular  screen  for  this  study  are: 

• the  test  strength  (TS)  of  a screen:  the  probability  that  a (previously) 
undetectable  failure  will  be  detected  by  the  screen. 

• the  costs  of  the  screen. 

While  there  are  literally  tons  of  material  on  screening  and  debugging  tests  the 
literature  search  turned  up  very  little  data  regarding  the  above  two  &ctors. 

This  is  not  surprising  since  if  much  data  existed  this  present  study  would  prob- 
ably not  be  needed.  A mathematical  model  is  a very  demanding  beast  and  can- 
not accept  inputs  like:  "about  10-12  thermal  cycles  should  do  it"  (see  refer- 
ence 8).  It  demands  inputs  like:  the  TS  for  this  screen  is  0. 73. 

However,  the  literature  search  was  valuable  in  pointing  out  what  screens  are 
likely  to  be  of  use  in  eliminating  defects  and  actually  there  is  little  disagreement 
on  the  matter.  The  useful  screens  appear  to  be: 

i)  temperature  cycling 

ii)  constant  temperature  "soak" 
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iii)  power  applied  continuously 

iv)  power  cycled 
V)  vibration 

vi)  various  combinations  of  these. 

Before  discussing  these  tests  an  important  issue  must  be  put  in  perspective: 
do  screening  tests  damage  good  items  (parts,  cards,  assemblies,  etc.)?  The 
general  consensus  from  the  literature  search  is  that  screens  do  not  damage 
good  items  if  the  screens  are  used  within  reasonable  limits.  It  is  obvious,  of 
course,  that  beyond  "reasonable"  limits  damage  could  occur  although  the  litera- 
ture is,  more  or  less,  silent  on  what  the  absolute  limits  are.  For  this  present 
study  the  matter  is  of  little  consequence.  The  SDO  model  is  concerned  with  the 
removal  of  defects  by  screens.  Test  strength  is  defined  as  the  (conditional) 
probability  of  detecting  a latent  defect.  The  fact  that  good  parts  may  also  be 
removed  affects  only  tlie  costs  of  the  screen  and  if  the  user  (of  the  SDO  model) 
has  a feel  for  tliis  probability  (of  damaging  a good  item)  he  can  factor  it  into  his 
cost  model. 

The  overwhelming  majority  of  the  literature  regards  temperature  cycling  as  the 
most  powerful  (without  regard  to  cost)  and  versatile  screen;  it  being  claimed 
that  temperature  cycling  screens  can  detect  part  defects,  worlcmanship  defects 
and  design  errors.  The  tliree  key  variables  (all  of  which  affect  TS  and  costs) 
of  a temperature  cycling  test  are 

i)  number  of  cycles 

ii)  rise  time:  rate  of  change  of  temperature  with  respect  to  time 

iii)  temperature  extremes 

The  literature  indicates  that  on  the  order  of  10  cycles  arc  used  for  parts/cards 
and  on  the  order  of  25  cycles  for  assemblies  and  equipments.  Rise  times  vary 
from  about  l°C/minute  to  something  like  10°C/minute.  'i'he  temperature  ex- 
tremes were  commonly  on  the  order  of  -60°C  to  125°C. 

Another  popular  screen  is  the  constant  (usually  higli)  temperature  soak.  The 
two  key  variables  of  a constant  ternpei’ature  screen  which  relate  to  the  TS  and 
costs  are  the  length  of  tlie  soak  and  the  temperature  of  the  soak.  The  literature 
agrees  that  the  same  kind  of  defects  can  te  eliminated  by  a constant  temperature 
screen  as  can  be  eliminated  by  a temperature  cycle  screen  although  for  equal 
times  at  equal  temperatures  the  temperature  cycle  screen  is  thought  to  have  a 
larger  TS.  There  was  no  agreement  at  all  in  the  literature  regarding  length  of 
the  constant  temperature  screen  altliough  100  to  300  hours  is  common.  Also, 
there  is  a belief,  though  no  exiDlicit  exj^ression  of  TS  was  found  (except  for  the 
Hughes  Aircraft  internal  work  called  CREDIT,  reference  42)  that  time  of  soak 
and  temperature  level  can  loe  "traded  off."  For  example,  1000  hours  at  70°C 
Is  equivalent  to  200  hours  at  125°C  in  TS.  Obviously  there  is  a tradeoff  since 
TS  is  a fimction  of  soak  time  and  temperature  used.  That  is,  TS  is  a function 
of  two  variables  and  in  3-dimensional  space  (TS,  soak  time,  temperature)  the 
relationship  is  a surface  which  might  have  many  common  points  TS.  Generally 
it  is  agreed  that  for  electronic  items  defects  are  not  detected,  that  is,  TS  is 
low,  until  about  50°C  is  used.  On  the  other  hand,  anything  over  about  125°C 
and  certainly  200°C  begins  to  damage  good  parts. 
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Power  apf  iication  is  another  popular  screen  even  though  by  itself  long  times  or 
number  oi  cycles  are  required  to  obtain  even  a moderate  TS.  Also  it  is  agreed 
cycled  power  is  more  effective  than  continuously  applied  power  for  equal 
amoimts  of  time  applied.  Notwithstanding  the  low  TS,  many  system  level  screens 
like  RPM  or  Duane  growth  control  programs  are  essentially  power  screens  on 
large  systems.  Thus  power  screens  are  most  effective  in  detecting  the  failure 
of  an  item  to  perform  a function  because  of  a design  error  rather  than  detecting 
bad  parts  or  poor  (as  against  incorrect)  workmanship. 

One  of  the  more  useful  applications  of  power  screens  is  in  conjunction  with 
temperature  screens.  \^en  a part  or  card  is  operated  at  high  temperatura, 
proteble  surface  contamination  problems  are  often  forced  to  a detectable  level. 
This  is  an  Arrhenius  type  effect.  IVhen  a bias  voltage  is  applied  during  high 
temperature  screens,  latent  defects  can  be  identified.  This  is  the  so-calUd 
Kyring  effect. 

Vibration  is  the  final  popular  screen  that  is  often  used.  The  consensus  seems 
to  be  that  vibration  should  be  random  and  that  vibratior  is  extremely  useful  for 
detecting  solder  joint,  lead,  connection  and  bond  problems.  There  was  no 
agreement  at  all  on  the  length  of  the  cycle  or  number  of  cycles  but  on  the  order 
of  about  1“20  cycles  was  common.  The  levels  ranged  from  Ig  or  2g's  to 
about  6g's. 

Various  combinations  of  the  above  screens  can  be  used  very  effectively  to  locate 
just  about  any  kind  of  latent  defect.  In  fact,  the  screens  used  and  the  levels  of 
the  variables  is  a cost/TS  tradeoff  and  this  is  wnat  the  SDO  model  does. 

2. 3 Industry  Survey 


2.3.1  Qu  e sti  onnaire 

Several  approaches  were  discussed  concerning  the  industry  questionnaire.  ITie 
final  approach  taken  was  that  of  a two  (2)  page  survey  which  could  develop  the 
data  necessary  to  the  purposes  of  this  study  in  a cost-effective  manner.  A 
copy  of  die  questionnaire,  along  with  the  guidelines.  Figures  2. 1,  2.2,  follow. 

The  response  to  the  survey  was  good,  A total  of  forty-two  (42)  data  points  was 
obtained  from  64%  of  the  respondents  to  the  questionnaire.  The  total  response 

..  . •!...».■»  -t  i^Crf  mi-  i_ 

to  tne  two  nunarea  questionnaires  aistnouteu  wus  j-rvo.  j.uis  j eBjjuuBc 

considered  good  in  comparison  to  the  results  of  other  surveys  trying  to  obtain 
similar  information,  i.e.,  Reliability  Study  Circular  Electrical  Connectors, 
RADC-TR-73-171,  which"  obtained  21%  response  out  of  600  surveyed,  and  the 
Bayesian  Reliability  Demonstration,  RADC  TR-7 1-209. 

Cost  data  was  obtained  in  67%  of  the  responses,  which  was  good  considering 
its  proprietary  nature,  while  some  form  of  screen  effectiveness  data  was  found 
in  93%  of  the  cases.  Data  was  gathered  at  the  part,  card,  and  higher  assembly 
levels.  The  distribution  of  the  data  is  shown  in  Table  2. 1. 
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• THE  MAIN  POINTS  OF  INTEREST  ARE 


• describe  the  screen  as  wcR  as  possible  (section  4) 

• describe  the  effectiveness  of  the  screen  (section  5) 

« estimate  costs  (section  G) 

• DO  NOT  BE  RELUCTANT  TO  MAKE  ESTIMATES 

• DO  NOT  BE  RELUCTANT  TO  LEAVE  BLANKS 

For  example,  in  section  (>  if  only  estimated  total  costs  are 
available,  do  not  woriy  about  fixed  and  variable  costs. 

Figure  2.1.  Guidelines  For  Screening/Debugging  Form 
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HUGHES  niHCHRFT  COHPHNY 


SCREENING  & DEBUGGING  TEST  DATA  FORM 


1.  NAME  OF  PERSON  COMPLETING  FORM 

ORGAIIIZATION  (WITHIN  COMPANY) 

2.  SCREENED/DERUGCED  (S/D)  ITEM  D F.  SC  H I P T t 0 N ; 


DATE  COMPLETED 


2,1  PART 


ASSEMBLY 


EQUIPMENT 


2,2  PART  QUALITY  LEVEL  PROCURED:  COMMERCIAL 


2.3  ITEM  NAMCCe.g.,  1,C.,  Diode,  Motor,  etc.) 


TYPE  OR  FUNCriON 


2. A QUANTITY  TESTED COMPLEXITY  Of  ITEM;  NO.  OF  PaKTS_ 

2.5  PARENT  "SYSTEM"  NAHE/TYPE 

3 . TEST  BACKGROUND 

3,1  WHY  WAS  THIS  ITEM  SELECTED  FOR  SCREEN 


3.2  PROGRAM  PHASE:  DEVELOPMENT 


PRODUCTION 


3.3  WAS  A FORMAL  RELIABILITY  DEMO  TEST  REQUIRED  ON  THE  OVERALL  PROGRAM 

3.4  PURPOSE  OF  SCREEN  DETECT: 


QUALITY  DEFECTS 


MANUFACTURING  DEFECTS 


DESIGN  ERRORS 


4.  TF,ST  DESCRIPTION 


4.1  TEST  DATES:  START 


4.2  TEST  CONDITIONS: 


4.2.1  SCREENING  STRESS(ES)  USED  

(E.C.  TEMPERATURE,  VIBRATION  ETC.) 

IF  MORE  THAN  ONE  TYPE  OF  STRESS,  GIVE  SEQUENCE 

4.2.2  MAX  STRESS,  MIN  STRESS,  RISE/DWELL  TIME  WHERE  APPLICABLE 
FOR  EACH  STRESS  USED 


PIGUlffi  2.2 
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HUGHES  PIHCHRFT  CQMPRHY 


4.2.3  LF.NCrH  OF  STRKSS  CYCLE  (HOURS) NUMBER  OF  CYCLES 

4.2.4  STRESS  EXCESn  RATED  REqUIREO;  YES NO 

I EXCEED  RATED /NOMl  NAI. 

4.2.5  POWER  APPLIED  DURING  TEST:  CONTINUOUSLY ? E R I OD  I C AL  l.Y_ 

HO  POWER 

4.2.6  APPLIED  POWER  EXCEED  RATED:  YES_ NO 

i EXCEED  RATED/HOMINAL 

4.3  PREDOMINANT  FAILURE  MO D ES /MECII  AN  ISMS  OBSERVED: 

5 . effective  NESS  OF  SCREEN 

5.1  PASS/FAIL  CRITERIA:  EXCEED  RATINGS DRIFT OTHER 

5.2  item  F.I.F.CTRICALLY  TESTED  BEFORE  SCREEN;  YES NO X DEFECTIVE_ 

5.3  X DEFECTIVE  (REJECT  RATE)  AFTER  SCREEN^ 

5.4  estimate  X IMPROVEMENT  (OVER  UNSCREENED  MTBF)  IN  ITEM  MTBF 

5.5  estimate  X IMPROVEMENT  (OVER  UNSCREENED)  IN  X DEFECTIVE 

5.6  DO  YOU  FEEL  THE  SCREEN  WAS  WORTH  THE  MONEY:  YES  NO 

5.7  DO  YOU  FEEL  THE  SCREEN  DESTROYED  A SICNIFICANT  I OF  GOOD  ITEMS: 

NO YES  X GOOD  ITEMS  DESTROYED 

6,  COST  OF  SCREEN  (DOLLARS) 

6.1  VARIABLE FIXED TOTAL 

6.2  COST  PER  ITEM  SCREENED;  VARIABLE FIXED __TOTAL 

6.3  COST  PER  DEFECTIVE  FOUND:  VARIABLF._ FIXED TOTAL 

7,  SEND  ME  A COPY  OF  THE  FINAL  REPORT  (ADDRESS) 

8 . REMARKS 


j’lGUPJi  2,2  (c  out 'dr 
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TABLE  2,1  Survey  Data  )3istribution 


Total  Response  17%  (34/200) 

Test  Level 

Test  Data 

Cost  Data 

Part 

24% 

100% 

60% 

Card/Module 

80% 

20% 

Equip/System 

64% 

93% 

78% 

The  responses  of  the  questionnaire  were  of  major  import  in  the  developing 
and  modeling  of  test  strengths  as  defined  in  Section  3.  4,  as  well  as  supplying 
"state-of-art"  Information  concerning  screening  and  debugging  techniques. 

2.  3.  2 Companies  Contacted 

Distribution  of  the  questionnaire  was  made  by  obtaining  a list  of  responsible 
contacts  who  could  supply  the  study  with  reliable  data.  It  was  decided  that 
the  GIDEP  (Government-Industiy  Data  Exchange  Program)  Roster  of  Repre~ 
sentatives,  in  addition  to  several  personal  contacts  of  stu^  personnel,  could 
provide  such  required  data. 

The  companies  chosen  were  felt  to  be  representative  of  the  "industry",  Several 
divisions  of  the  larger  corporations  were  contacted  in  hopes  of  comparing  the 
data  for  standardization  of  costs,  etc, , however,  results  in  this  regard  were 
insufficient. 

Table  2.2  is  the  listing  of  companies  chosen  for  distribution  of  the  questionnaire. 
2,3.3  Survey  Data 

Out  of  the  forty-two  (42)  data  points  supplied  by  the  industry  survey, 
thirty-four  (31)  wore  found  to  be  sufficient  tc*  determine  teat  strengths  for 
their  respective  screens. 

Due  to  several  referenced  screen  parameters  being  identical,  a total  of 
seventeen  (17)  different  test  strengths  were  determined.  The  following 
Table  2.  3 presents  the  data  obtained  fx’om  the  industry  survey  and  their 
respective  test  strengths.  These  test  strengths  were  computed  from  the 
equations  given  In  Section  4.  2. 
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TABLE  2.  2 Companies  Contacted 


Aerojet  Electrosystems  Co, 
Aoronutronic-Ford  Corp. 

Aerospace  Corp. 

Ail  Cutler-Hammer 
Avco  Corp,  Systems  Div. 

Beckman  Instruments 
Bell  Aerospace  Co. 

Bendix  Corp. , Guidance  Systems  Div. 
Bendix  Corp. , Aerospace  Sys  Div. , 
Mishawaka  Operation 
Bendix  Corp. , Aerospace  Sys  Div. 

Booz- Allen  Applied  Research  Inc. 

Boeing  Aerospace  Company 
Bulova  Watch  Co. 

Bunker-Ranio  Coip. 

Celesco  Industries  Inc. 

Chrysler  Corp. 

Cincinnati  Electronics  Corp, 

Control  Data  Corp. 

Crane  Co. 

Cubic  Corp. 

Curtiss  Wright  Corp. 

Dalmo-Victor  Co. 

DeLco  Electronics 
Delco  Electronics  Div. , General 
Motors  Corp. 

Digital  Equipment  Corp. 

Douglas  Aircraft  Co. 

Electro  Optical  Systems  Inc. 

Electronic  Communications  Inc. 
Electrospace  Systems  Inc. 

Eiiici'cori  Elcct'X'i-C  Co# 

EMR- Telemetry,  Weston  Instr. 

EPSCO  Inc. 

E-Systems  Inc 

Fairchild  Hiller  Corp. 

Fairchild  Republic  Co. 

Fairchild  Space  & Defense  Systems  Div, 
Fairchild  Stratos  Div. 

FMC  Corp. 

Foxboro  Co, 


General  Atomic  Co. 

General  Dynamics  Corp.  , Electro 
Dynamics  Div. 

General  Dynamics  Corp.  , Electronics  Div, 
General  Electric  Co. , Research  & 
Development  Center 
Goodyear  Aerospace  Corp. 

Giaimman  Aerospace  Corp. 

GTE  Sylvania  Inc.  Elect  Systems  Group, 

V cstern  Div. 

GTE  Sylvania  Inc,  Elect  Systems  Group, 
Eastern  Div. 

Harris  Corp. 

Harris  RF  Communications  Inc. 

Hartman  Systems  Div.  A-T~0  Inc. 

Hazcltinc  Corp. , Electro-Acoustic  Lab 
Mazeltine  Corii.  , Electronics  Div. 

Hercules  Inc. 

Hermes  Electronics  LTD. 

Hewlett  Packard  Co. 

Hittman  Assoc,  Inc. 

Hoffman  Electi'onios  Corp. 

Homes  & Naiwer  Inc. 

Honeywell  Inc. , Marine  Systems  center 
Honeywell  Inc. 

Honejrwell  Inc.  Aerospace  Div. 

Honeywell  Information  Sys  Inc. 

Honeywell  Inc. , Go^d  & Aeronaut  Prod  Div. 
Honeywell  Radiation  Center 

IBM  Coi'p. 

IBM  Corp. , Electronics  Systems  Center 
Interstate  Electronics  Corp. 

Itek  Corp. 

ITT  /optic ill  V- 

ITT  Avionics 

ITT  Federal  Electric  Corp 
ITT  Gilfilian  Inc. 

Jet  Propulsion  Laboratory 

Kaiser  Aerospace  & Elec  Corp. 

Klauder,  IjOuIs  1'  & Assoc. 

Kollsman  Instrument  Corp, 
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TABLiE  2.  2 Compaiiles  Contacted  (Com.) 


I.Awrence  Livermore  Lab. 

Leeds  & Northrup  Co, 

Ijfe  Systems  Inc, 

Little.  Arthur  D.  Inc. 

Litton  Data  System  Div. 

Litton  Systems  Inc. 

Lockheed  California  Co. 

Locklieed  Electronics  Co. 

Lockheed  Georgia  Co. 

Lockheed  Missiles  & Space  Co. , 

Space  Systems  Div. 

Lockheed  Missiles  & Space  Co. , 

Missile  Systems  Div. 

Loral  Electronics  Corp. 

Martin  Marietta  Coip. 

Martin  Marietta  Aerospace 
Martin  Marietta  Aerospace 
McDonnell  Douglas  Astronautics  Co,  West 
McDonnell  Douglas  Electronics  Co. 
Mechanics  Research  Inc. 

Motorola  Inc. 

National  Water  Lift  Co. 

Nature— Crafts 

Northrop  Corp. , Electro/Mech  Div. 
Northrop  Corp. , Electronics  Div. 

Northrop  Corp. , Aircraft  Div. 

Pacific  Car  & Foundry  Co. 

Parker  Hannifin  Corp. 

Parsons  Co. 

Perkin-Elmer  Corp. 

Plessey  Industries  Inc. 

RCA  Astro  Electronics  Div. 

RCA,  Aerospace  Systems  Div. 

RCA,  Govt  & Comm.  Sys. 

RCA,  Mssile  & Surface  Radar  Div. 
Raytheon  Co. , Electro  Magnetic  Sys,  Div. 
Raytheon  Co. , Missile  Systems  Div. 
Raytheon  Co,  Lever  Bldg. 

Raytheon  Co,  Equipiment  Div, 

Reflectone  Inc. 

Rel-Reeves  Inc. 

Rexnord  Inc. 

Rockwell  International  Electronics 
Operations 

Rockwell  International  Rocketdyne  Div, 
Rockwell  International  Space  Div, 


Roclcwell  International  Collins  Radio  Group 
Electronics  Oper  DI 

Rockwell  International!  Collins  Radio  Group 
Electronics  Oper  DI 

Rockwell  International  Columbus  Aircraft  Civ. 
Roclcwell  International  Collins  Radio  Group 
Rohr  Industries 

Sanders  Associates 
Sandia  Laboratories 
Sangamo  Electric  Co, 

Science  Applications  Inc. 

Science  Applications  Inc. 

Scott  Electronics  Corp. 

Sedco  Systems  Inc 
Sierra  Research  Corp. 

Singer  Co. 

Singer-Kearfott  Div. 

Solar  Div. 

Sperry  Marine  Systems  Div. 

Sperr>'  Microwave  Electronics 

Sperry  Rand  Corp. , Sperry  Flight  Sys,  Div. 

Si)erry  Rand  Corp.  Systems  Mgt.  Div. 

Sperry  Rand  Corp.  , Sperry  Systems  Mgt. 
Stoncel  Aero  Engineering  Corp, 

Stone  Si  Webster  Engineering  Corp. 

Stromberg  Carlson  Corp. 

Stromberg  Datagraphix  Inc. 

Systematics  General  Corp. 

Systems  Associates  Inc. 

Systems  Evaluation  Inc. 

Telctronix  Inc. 

Teled3me  Cae 

Teledyne  Ryan  Aeronautical 
Teledyne  Systems  Co. 

Texas  Instruments  Inc. 

Tracor  Inc. 

TRW  Equipment  Group 

TRW  Systems  Group 

TRW  Color..do  Electronics  Inc. 

IJnidynamics 
Union  Carbine  Corp. 

Union  Switch  & Signal  Div. 

United  Engineers  & Constructors  Inc. 

United  Nuclear  Industries  Inc. 

United  Technologies  Corp. , Norden  Div. 
United  Technologies  Corp.  , Hamilton 
Standard  Div. 

Univac,  Div  of  Sperry  Rand 
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TABliE  2.  2 CompanitJd  Contacted  (Cont) 


Value  Engineering 

Vega  Precision  Laboratories  Inc. 

Vitok  Engineers  Inc. 

Vought  Corp. , Michigan  Div. 

Vought  Cori:. , Systems  Div. 

Westinghou.se  Hllectric  Corp.  , Marine  Div. 
Westinghousc  Electric  Corp.  , Def  & Elect 
Sys.  Center 

Westinghousc  Electric  Corp.  , Industrial 
Equipment  Div. 

Westinghouse  Electric  Corp.,  Astronuclear  i^b 
Weston  Instruments  Inc. 

Weston  Instinaments  Inc. 

Wiggins  EB 

Zimmer  - USA 


16 


TABLE  2.  3 Industry  Survey  Data 

Time  is  Eroressed  in  Hours 
Temp  is  Ejqpressed  in  ^‘C 
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2.4 


Internal  Data 


2.4.1  Hughes  - Fullerton 

Much  of  the  cost  data  used  in  the  study  was  extracted  from  Hughes- Fullerton 
facilities.  Due  to  the  many  and  varied  factors  contributing  to  this  cost  data, 
an  attempt  was  made  to  ascertain  the  needed  information  on  a "typical"  card, 
module,  unit,  and  system  level.  This  was  accomplished  through  an  averaging  > 

of  costs  associated  with  particular  programs. 

System  data  was  collected  from  fourteen  (14)  on-going  Hughes- Fullerton  * 

progi’ams.  Systems  Effectiveness  Department  personnel  supplied  the  study 
with  data  in  the  following  fields;  MTBF  (specified,  predicted,  initial,  final), 
operating  time,  environmental  time/ conditions,  percent  of  non-standard  to 
total  number  of  parts,  total  number  of  subcontractors  (on  assembly  level), 
complexity  (part  count)  and  Operations  and  Maintenance  Reports  (OMR's). 

Additional  system  level  data  was  extracted  from  The  Reliability  Growth 
Study,  Ref.  47,  conducted  at  Hughes- Fullerton. 

The  in-house  systems  contributing  the  above  mentioned  data  are: 

eVTSe  - DiuSplay  Console 

FPD  - Shipboard  Radar 

I.FR  - Low  Frequency  Receiver 

PRC  104  - Portable  Radio 

SID  - Display  Console 

SLQ  31  - Electronic  Warfare  Sui. 

TDMA  - Communications  Terminal 
TPQ  3G  - Moiiar  LocaLox-  Radar 
TPQ  37  - Artillery  Locator  Radar 
UYQ  - Console 

COMBA3’  GRANDE  - Air  Defense  System 
MK  31  - Weapon  Control  Console 
MK  82  - Weapon  Data  Converter 
SURTASS  - Towed  Sonar  Segment 

2.4.2  Additional  Hughes  Aircraft  Site.s 

The  Hughes  sites  that  contributed  to  the  .study's  main  data  base  in  addition  to 
Huehcs-Fullerton  were  Culvrm  Citv.  FI  Scpiindo.  and  Tiioson.  fiiinnlpmonf-aTv 

- ^ - _ ..J,  

cost  data  was  obtained  from  El  Segundo  manufacturing  personnel,  screening 
strength  equations  were  contributed  by  Culver  City,  while  te.st  effectiveness 
data  was  contributed  by  all  three  of  these  additional  sites. 

The  program s/eximriments  contributed  by  these  Hughes  Aircraft  Company 
sites  consist  ol;  F-15  Radar  Control;  Maverick;  B-52;  and  F-IG. 

The  following  table  2.  4 rejmesents  the  te.st  data  olxtained  from  these  sources, 
combined  with  the  test  strengths  computed  from  the  test  strength  cquation.s, 

Section  4.  2. 
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TABLE  2.4  Hu^es  Internal  Data 
Time  is  E^ressed  in  Hours 
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TABLE  2.4  Hughes  Internal  Data  (Cont) 


SECTION  3.0  - DESCRIPTION  OF  IMPORTANT 
MODEL  VARIABLES 

3.1  Role  of  Test  Strength  in  the  Screening  and  Debugging  Optimization  (SDO)  Model 

The  idea  in  a sequence  of  screens  is  the  successive  removal  of  defects.  For 
screens  that  do  not  damage  good  items  the  probability  of  "catching”  a,  defect 
is  generally  not  one.  Thus  if  Dj  defects  are  submitted  to  the  first  of  k_2l  _ 
screens  the  number  of  defects  caught  by  the  first  screen  will  be  (say)  < Dj. 
The  number  of  defects  entering  the  second  screen  (neglecting  rework  cycles 
to  simplify^ the  illustration)  is  the  Dj  - and  if  the  number  caught  by  the  second 
scre^  is  P2  £ Dj  - the  number  of  defects  entering  the  third  screen  is 
Dj  - Dj^  - D2  and  so  on. 

Test  strength,  the  probability  that  a given  defect  will  be  caught  by  the  k ^ screen, 
is  called  TSj^  and  TSj^  assists  in  providing  a mathematical  model  fur  the 
screening  process.  The  actual  number  of  defects  removed  solely  by  the 
screen  is  a random  variable  whose  domain  is  the  set  of  positive  integers 


k-1 


i=l 


where  of  course  D^,  the  number  removed  at  the  i^^  screen,  Isisk  is  also  a 
random  variable.  To  carry  the  analysis  thi  o ighout  the  process  on  the  basis  of 
random  variables  is  quite  complicated  so  wt  ueal  witli  expected  values.  Thus, 
if  Dj  defects  enter  screen  one,  two  quantities  are  of  Interest 

i)  the  expected  number  of  defects  entering  the  second  screen: 

Dj  - TSjDj  = (1  - TSj)  Dj.  That  is,  this  quantity  is  the  expected 
number  of  defects  not  caught. 

il)  the  expected  number  of  defects  removed  by  the  first  screen; 

(TSj)  Dj. 

The  expected  number  of  defects  removed  by  the  second  screen  is  (TSj^)  x 
(I  - T.Sj)D- and  hence  the  expected  number  of  defects  entering  the  third 
screen  IS  (1  - TSj)  (1  - TS2)  Dj.  The  expected  number  of  defects  removed 
by  the  third  screen  is  TS3  (1  - TSj)  (1  ~ TSg)  Dj  so  that  the  expected  number 
of  detects  entering  the  fourth  screen  i;;  (1  - TSj)  (1  - T.S9)  (1  - TS3)  Dj. 

In  general  then  the  expected  number  of  defects  entering  the  k'h  successive 
screen  is 


k-1 

11  a-TE)D 

i=l  ' ^ 

and  if  the  sequence  is  stopped  at,  but  including,  the  screen  the  final 
defects  remaining 

D = I I (1  -TS  ) D 
1=1 

In  the  next  section  we  obtain  interval  estimates  of  the  random  variable  Dj. 
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3.2 


Interval  Estimates  for  the  Number  of  Defects  Remaining,  - Monitoring/ 
Controlfing  the  Screening  Process. 

As  noted  in  the  previous  section  the  entire  process  of  starting  with  initial 
defects  and  removing  defects  by  a sequence  of  screens  until  there  ar4  only  Dp 
defects  left  after  the  last  screen  is  a random  process.  The  SDO  model  works, 
necessarily,  with  expected  values;  to  do  othei^se  would  result  in  enormous 
costs. 


However,  the  fact  remains  Dj,  Dp  are  random  unknown  quantities  and  the 
model  works  with  the  expected  values  of  Dj  and  Dp.  Now  suppose  there  are 
k>l  screens  in  the  entire  process  with  TSi,  i=l,  . . . , k the  test  strength  of 
the  i^“  screen.  The  only  observable  (ran^m)  quantities  are  the  number  of 
defects  caught  at  each  screen,  ^[,  where  represents  the  number  caught  at 
the  screen.  It  would  be  of  value  to  have  confidence  interval  estimates  of 
Dj  and  Dp;  neither  of  which  is  observable.  Dp  is  particularly  important 
because  it  is  the  number  of  defects  remaining  m the  "system"  after  the  last 
(kl^)  screen  is  completed.  We  note  again  that 


That  is,  the  number  of  defects  remaining  after  the  last  (k^^)  screen  is  the 
initial  number  present  minus  the  total  of  those  removed,  caught  or  detected. 


It  is  fairly  easy  to  show  that  the  probability  distribution  of  Dj^,  the  number  of 

cicCtS  CEugXit  uic  lEoi.  bCxcCxi  its  UAiiuuiiai  wiux  paxi^iiiC/VC/iS  Eiiu 


fl  (Tf 

i=l 


(TS.) 


where 


TS.  = 1 - TS. , i.  e, , 


X 

k 

. 1 I Tmrtm 

‘\xl 

1-11  IS 

L J 

D,-X 


In  this  expression  there  are  three  quantities  of  importance;  D^  (not  observable), 

k _ 

n TS, 

i=*l 

(computable  from  the  test  strength  equations)  and  X the  observable  number  of 
defects  actually  caught  at  the  last  (k^")  screen.  Hence  the  known  quantity 

k 

n 

1-^1 

and  the  observable  quantity  X can  be  used  for  inference.?  on  I)j. 
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Once  having  obtained  inferences  on  Dj  we  can  obtain  inferences  on 

k 

since  k 

i=l 

is  observable  (it  is  the  total  defects  detected).  Of  course  only  upper  confidence 
bounds  on  Dp  are  of  interest.  If  not  all  the  parts  are  tested,  the  value  of  Dp 
must  be  adjusted  according  to  what  fraction  is  tested. 

Example 


Suppose  k = 3 screens  with  test  strengths  = 0.50,  TS2  = 0.50,  TSg  = 0.20. 
Suppose  also  that  at  screen  one  6 defects  are  caught,  at  screen  t^  2 defects 
are  caught  and  at  screen  three  1 defect  is  caught.  Then  D^  = G,  D2  = 2, 

D3  = 1.  Thus 


3 3 

y 13^  = 9 and  f]  = (0.50)(0.50)(0.80)  ==  0.20,  TS.  (1  - TSp. 
i=l  i=l 

Hence, 

D \ D -X 

P(D2  = X)  = ( (0. 20)^  (0.  80)  ^ . 


But  wc  have  observed  X = 1.  Proceeding  to  tables  of  the  binomial  probability 
distribution  with  "p"  - 0.  20  we  find 

P(X<  1 I D^  = "n"  = 20)  = 0. 07 

Hence  the  confidence  is  0.  93  that  D^D  <19,  and  hence  the  confidence  is  0,  93 
that 

3 

Di-E  E = Dj,, 

is  less  than  or  equal  to  19-9  = 10. 


These  interval  estimates  can.  bo  prepared  AhTEK  EACH  SUCCESSIVE  SCREEN 
to  monitor /control  the  evolution  of  the  entire  process.  That  is,  the  interval  esti- 
mate of  Dp  at  the  stage;  can  be  compared  with  the  expected  results  (at  the 
m^^  stage): 


in 


Dp  = K(Dj) 


m 

II 

i=l 


TS. 


i 
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where  (Dj)  is  expected  value  of  Dj  used  in  the  SDO  model.  Discrepancies 
between  observed  and  expected  results  must  be  resolved  between  two  items:  was 
tlie  initial  (Dx)  incorrect  or  is  one  (or  more)  of  the  TS^'s  incorrect.  In  any 
case  the  observed  Dp's  can  be  projected  ahead  to  see  what  Dp  might  finally 
be  by  using  the  TSm+i,  TS^+2»  * • • > to  predict  the  final  Dj,  from  the 
observed  results  up  to  the  m^h  test  and  the  expected  results  from  the  (Mi  1)®^ 
stage  to  the  stage. 

Example 

We  continue  with  the  previous  example  and  suppose  there  is  one  more  last  test 
to  be  run  with  TS4  = 0. 15  and  after  all  four  tests  we  had  hoped  to  have  Dp£8. 

We  already  have  any  upper  confidence  limit  of  10  on  dS  and  Dp  = = 

TS4  (D^)  = (0.  85)  10  = 8.  5 which  is  an  upper  0.  93  confidence  limit  on  Dp  and 
the  achievement  of  Dp£8  appears  to  be  entirely  feasible. 

3,3  Role  of  Part  Level  Screens 


The  SDO  model  developed  as  a result  of  this  .study  doe.s  not  include,  explicitly, 
a part  level  screen.  This  was  done  for  two  rcason.s.  As  will  be  described 
in  Section  5.  0 the  initial  number  of  defects,  Dj,  is  an  entry  variable  in  the 
model.  Dj  is  a function  of  the  number  of  parts,  say  N,  in  the  system  (a 
quantity  known  to  a careful  reliability  engineer),  and  the  fraction  defective, 
say  p,  of  the  incoming  parts.  Thus,  Dj  = NpS  ^here  S is  the  number  of  systems) 
and  p is  a function  of  quality  level  (c.g. , commercial,  B-level)  of  part  purchased. 
In  order  to  keep  the  CPU  time  and  core  requirements  of  the  SDO  model  within 
bounds  it  was  felt  that  the  u-ser  can  easily  price  the  various  qufility  grades  and 
compute  Dx  as  a function  of  quality  (p)  and  price  then  for  each  Dj  run  the  SDO 
model  to  see,  as  Dj  varies,  which  is  the  most  economical  part  quality  level  to 
purchase.  For  example,  suppose  the  final  tolerable  defects  Dp  = 20  and  that  "to 
go"  from  Dj  = 500  to  Dp  = 20  costs  $100, 000  worth  of  screens  and  that  to  go  from. 
Dj  = 250  to  Dp  = 20  costs  $03,000  worth  of  screens.  Now  suppose  N = 25,000 
and  p = 0,  01  for  B-level  and  p = 0.  02  for  commercial  parts.  If  the  incremental 
cost  of  the  B-level  parts  is  less  than  $37,000  it  is  cheaper  to  start  with 
B-level  parts. 


The  .second  reason  part  level  screens  have  been  omitted  from  the  model  is 
the  "exploding"  effect  of  part  level  defects  when  the  parts  are  assembled  on 

•I  V 11  ■ , . • . 1.1.  _ j. -t  .! _,.Ui  1 1-4  ...-1.. 

CcirUK,  WXia<t  uicIL  ptij-b  wiiiit;  j.  cucin 

inexpensive,  mu.st  have  a tremendously  high  (near  one)  TS  to  prevent  defective 
cards.  For  examjjle,  suppose  a large  (the  fiart.s  are  used  on  many  programs 
not  just  "yours")  part  population  which  ha.s  p = 0.  02  and  that  the  card.s  will  have 
150  parts/card.  Then  the  expected  number  of  defects  per  card  is  0.  02  x 3 50  - 3 
and  .since  it  takes  only  one  or  more  bad  part.s  to  make  a bad  card  it  is  clear, 
using  the  Poisson  approximation,  the  fraction  of  bad  cards  (a  card  with  one  or 
more  defects)  is  on  the  order  of  0.  95.  Thu.s  to  keep  the  fraction  bad  cards  low 
the  parts  must  be  screened  with  high  TS.  For  example,  suppose  TS  (at  the 
part  level)  i.s  so  high  that  p = 0.  02  can  be  reduced  to  0.  001,  a 20-1  reduction. 
Then  the  expected  number  of  defects/card  i,s  0.  001  x 150  = 0.  15  and  the  fraction 
of  bad  cards  is  on  the  order  of  0. 14  - a reduction  by  a factor  of  only  7-1. 
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P(X, 


A more  accurate  analysis  requires  some  notation  and  a small  amount  of 
probability  calculus.  Let  the  following  definitions  be  made: 


N = number  of  parts  in  lot 

M = number  of  cards  to  be  made  ) , , 

) mMsN 

m = number,  of  parts  per  card  ^ 
p = fraction  defective  of  the  lot 

= number  of  defective  parts  on  the  i^h  card  i = 1,  . . . , M 

Then  Np  is  the  total  number  of  defective  parts  in  the  lot,  the  X.  are  random 
variables  and . ^ 


Xf,  ....  Xj^) 


■/NpVN-Npy 

^XiAm-xJ 

/Np-Xj^wN-m-(Np-Xj^)\ 

\ ^2  A "^-^2  / 

/N\ 

/N-m\ 

(m  j 

X 


M-1  \ / M-1 

^Np  - ^ “ (M-l)m  - (Np  - ^ Xj^ 

i=l  /I  i=l  ' 


M 


m-x 


M 


'N  - (M-l)m’ 
m 


whei’e 


xl 

yl(x-y!) 


x>y 


The  card  fraction  defective  is  then  (since  it  is  clear  that  it  is  immaterial  which 
l5i<M  of  the  M cards  is  defective  and  :6ero  defective  cards  contributes  nothing 
to  the  sum,  i.e, , O/M  = 0). 

M 

1 {s)(T)  I'P'l  ' » 


2G 


where 


P(X^  - 0,  0,  .... 

S " ^1’  ’ • • * ^M  " 

^M-i+1’  •’•» 

X^,  ...,  Xj^_.  = 0 


Sv 


mN 


The  following  examples  give  a very  few  results  smee  the  computations  involved 
can  quickly  out-distance  even  a large  high-speed  digital  computer. 

Kxampie  1 

M = 1000,  p = 0.  01,  m = 50,  M = 10;  the  card  fraction  defective  is  about  0i40, 


lixample  2 


N = 5000,  p = 0.01,  m - lOO,  M = 25:  tlie  card  fraction  defective 
is  about  0. 03, 

3.4  Determination  of  Test  Strength  (TS) 

The  ability  of  particular  screen  to  detect  incipicnt/latent  defects  will  be  called 
test  strength  (TS)  and  is  represented  formally  as  a probability 

TS  = the  probability  that  a given  screen,  including  the  test  set-up, 
will  detect  an  incipient/latent  defect. 

The  portion  of  TS  relating  solely  to  the  ability  of  the  screen  to  degrade  the 
defect  to  a detectable  level  is  called  screening  strength,  SS,  and  the  portion 
relating  to  the  aljility  of  the  test  equipment/set-up  to  detect  the  defect  once 
it  has  been  degraded  to  a detectable  level  is  called 

Thus,  TS  = SS  X Pj. 

Ordinarily,  TS  is  not  computable  or  estimable.  Tor  any  given  screen  (with  test 
set-up)  TS  could  be  estimated  by 

_ number  of  defeed.s  detected  alter  screen 
number  of  defects  entering  screen 

Unfortunately,  the  denominator  of  this  fraction  is  usually  unknown.  It  would  be 
possible  to  estimate  TS  by  placing  a kno\vn  number  of  bad  items  on  the  screen 
and  observing  the  results  but  we  could  uncover  no  such  experiments.  Many 
experiments  involve  comparing  screens  for  their  relative  TSs.  Thus,  if  100 
cards  are  put  on  each  of  five  different  screens  (say  Sj,  Sg,  . . . , S5)  then  assum- 
ing the  numljcr  of  defects  entering  the  live  screens  are  equal,  tlie  screens  can 
be  ranlced  by  the  number  of  defects  discovered  by  the  screens  and  the  screen ; 
with  the  largest  fallout  will  be  best.  However,  these  sorts  of  results  do  not 
permit  actual  computation  ol  TSj,  i = 1,  5 but  only  permit  computation  of 

the  ratios 

TS. 

ts7  ■ j ^ • ' • > ^ • • • > 'U 
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Two  approaches  to  computing  TS  are  available  and  both  have  been  used  in 
this  study.  First,  from  the  results  of  the  qucstioimaire,  several  respondents 
felt  they  had  enough  experience  with  incoming  defect  rates  so  that  we  could 
compute  TS  for  these  responses.  This  occurred  about  fifteen  times.  The 
second  approach  is  to  build  mathematical  functions,  derived  from  the  physics 
of  the  screening  environment,  which  yield  TS  (or  SS).  This  has  been  done  by 
the  Hughes  Aircraft  Company  in  their  Cost  Reduction  by  Early  Decision 
Information  Techniques  (Ref  42)  program  (Report  No.  TIC  20-42--732-R 
(P73-218)).  In  that  report,  equations  are  given  for  SS  for  vibration,  con.stant 
temperature  and  temperature  cycling  screens.  These  equations  were  used  to 
compute  the  SS  used  in  the  cost  models.  Before  giving  these  equations  we  note 
that  such  equations  are  not  available  for  power  applied  screens  and  this  power- 
applied  case  is  treated  first. 

Probability  of  detection,  P^,  presents  a different  problem:  it  is  highly  dependent 
on  the  individual  test  setups.  We  have  not  found  nor  have  we  developed 
quantitative  models  for  computing  P^j.  However,  the  factors  to  be  included  in 
Pf}  are:  possible  failure  modes,  functions  performed,  functions  tested,  test 
equipment  available,  test  equipment  quality  and  calibration,  instrumentation 
setup  and  data  recording. 

3. 4. 1 TS  for  Power  Continuously  Applied  Screens 

Seven  respondents  to  the  questionnaires  had  conducted  continuously  applied 
(rated)  power  tests  with  all  other  conditions  at  ambient.  We  were  able  also 
to  compute  the  TS.’s  for  these  seven  tests  and  of  course  the  seven  test  times, 
ti,  were  also  available.  The  usual  procedure  is  to  fit  (to  the  data)  various 
linear  or  linear-izable  functions  by  least  squares  and  select  the  one  which  is 
best  fit.  In  the  present  case,  TS  must  satisfy  OsTSsi  so  we  first  selected  a 
function  of  t (time  of  continuously  applied  rated  power)  such  that  TG  = 0 at 
t = 0 and  TS  = 1 at  t = <».  Such  a function  is 


Obviou.sly. 


TS  = g(t) 


bt 

a + bt 


a,  b,  t>0. 


= 0 elsewhere. 


TS 


= = 


a 

b 


t 

+ t 


so  tJiat  TS  depends  only  on  the  ratio  a/b  = c. 

TS  = g(ti  = (1) 

A description  of  the  results  for  obtaining  the  constant  c is  contained  in 
Section  4.1.  No  data  was  available  for  the  case  when  the  power  applied  was 
other  than  rated. 
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TS  for  Cycled  (ON/OFF)  Rated  Power 


The  continuously  applied  rated  power  case  is  just  a special  case  of  this  present 
case  when  the  number  of  cycles,  say  is  one.  Now  suppose  Nc>l,  then  TS, 
the  probability  of  detection  is  just  one  minus  the  probability  of  non-detection  in 
Nc  cycles.  That  is, 


TS  = 


(2) 


where 

= number  of  cycles 
t = length  of  a cycle  in  hours 
This  reduces  to  equation  (1)  when  = 1. 

At  first  glance  it  appears  that  equation  (2)  "neglects"  the  screening  effect 
due  solely  to  the  act  of  "turning"  the  power  off  and  on.  This  is  not  quite  true 
as  can  be  test  seen  by  an  example.  Suppose  = 18  and  t = 4.  Then  from 
equation  (2),  using  c = 886,62, 


TS 


= 0.078. 


If  however  we  choose  to  neglect  the  cycling  and  just  assume  4 x 18  total  hours 
of  screening  and  apply  equation  (1) 


TS  — ■ — = — — = 0 075 

72  + 886.62  958.62 

which  is  less  (test  strength)  than  0.  078.  It  is  trivial  to  show  that  equation  (2) 
always  gives  greater  TS  than  equation  (1)  with  t'  - N^t  where  t is  the  length 
of  a cycle. 

Thus,  the  effect  of  the  on/off  portion  is  included.  Equation  (2)  may  be  gen- 
eralized to  the  case  where  each  of  the  cycles  has  a differing  time 
fjj  i — 1,  ...,  Nq! 


Determination  of  Initial  (Ilj)  and  Final  (Dp)  Defects 

Tc  tliC:  GDC  rnodid  for  minimizing  corst  the  u.scr  must  enter,  among  other 
parametric  values,  the  initial  (Dj)  and  final  (Dp)  number  of  defects  desired. 

Dj  should  be  bas(jd  on  tin;  total  parts  count  for  the  system,  the  number  of  systems, 
and  the  expected  part  fraction  defective.  Tliis  latter  number  will  ordinarily  be 
based  on  the  quality  level  of  parts  purchased  lor  each  of  the  major  part  types.  For 


example  suppose  a system  is  composed  of  mil  std  parts  (B  and  C level  quality 
grades)  as  well  as  non-standard  parts,  then  Dj  is  calculated  as  follows: 


Part  Typo 

Quantity 

Quality  Grade 

% Defective 

Resistors 

1,000 

C level 

3 

ICs 

10,000 

B level 

1 

Non-standard 

(various) 

3,000 

non-mil  std 

5 

Dj  = 1,000(0.03) 

1 10,000  (0.01) 

3, 000  (0. 05)  = 

280 

The  computer  program  defaults  to  1%  in  the  absence  of  user  specification. 

Dp  is  determined  by  using  the  mature  MTBF  Oa/j  (e.g.  , obtained  from  a 
MIL-HDBK-217B  prediction),  Gp  the  required  MTBF  before  field  delivery, 
and  a relatively  long  period  of  field  operation,  say  t,  in  the  following  equatior 


D 


F 


t 


(TS) 


The  left  hand  term  in  the  bracket  is  the  expected  number  of  failu]  os  in 
t (field)  hours  w'hen  the  MTBF  IS  6p,  the  at-delivery  MTBF.  The  right  hand 
term  is  the  expected  number  of  ranclom  failures  in  t (field)  hours.  Thus  the 
difference  is  the  expected  number  of  engineering  errors,  manufacturing  quality 
and  unreliability  failures  removed  during  t (field)  hours.  When  this  difference 
is  divided  by  the  test  strength  for  t (field)  hours.  Dp  is  obtained.  That  is, 
the  equation 


Dp  x TS 


01 


is  solved  for  D, 


The  SDO  model  lias  this  equation  in  it  w'ilh  t = 2(3. 2b0  hrs  (3  years  operation)  and 
the  computation  of  TS  is  performed  by  the  program. 


lCxs.rnpl6 


Suppose  6p  = 300  hours,  O^j  = 420  hours,  and  1 = 10,  000  hours  with  no 
temperature  or  vibration  excursion  expected  during  field  operations.  Then, 
(see  Section  4. 1.  2). 


TS  = 


10,000 


t ^ c 


777:  = 0.71 


10,000  + 4,00(3 
t/o  = AP>  = 33  a-  i/n  = 10, 000  _ 23  3 


and 


.,3.,  , ,3, 
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SECTION  4.  0 --  DATA  ANALYSIS  FOR  MODEL  PARAMETERS 


4. 1 Computation  of  Test  StrenKlh  for  Power  Applied 

4, 1.  I Test  Strength  (TS)  for  Card/Unit  Level: 

The  BMD07R,  non-linear  least  squares  computer  program  (described  in  the 
Appendix)  was  used  to  find  the  parameter,  c,  in  the  functional  equation: 

TS  = t/(t  + c)a  Using  the  seven  data  points  shown  in  Table  4. 1 (which  were 
obtained  from  the  questionnaire),  an  Initial  estimate  of  c = 1000.  0 allowed  the 
iteration  scheme  to  converge  in  a few  steps  to  c = 8B6.  62. 

These  surv'ey  points  were  also  used  to  find  a and  c in  TS  = (t/(t  + c))^  and  a and  b 
in  TS  - 1.  0 - exp  [-(t/a)^].  However,  using  these  functional  equations  did  not 
improve  upon  the  performance  of  TS  - t/(t+c)  wiih  respect  to  low  estimating 
error. 


The  QKPLOT  graphics  subroutine  (described  in  the  appendix)  was  then  used  to 
plot  Test  Strength  (TS)  versus  time  (t)  using  the  equation  TS  = 1.0  - (886.62/ 

(t  + 886.62))^^c,  Three  curves  were  produced  where  N^  = 1,  N^  = 5,  and 
Nc  --  10  (see  Figure  4. 1)  as  a means  of  illustrating  the  improvement  in  TS  a.s 
Nc,  the  number  of  cycles  gets  large. 

Another  illustration  worth  looking  at  is,  for  fixed  total  time  T,  the  improvement 
in  cycled  power  versus  continuous  power  applied. 

Suppose  the  total  time  of  pow'cr  applied  T = 200  hours.  We  consider 

Case  1 200  hours  of  continously  applied  power 

" rrS  200  + 886.62  " 


Case  2 2 cycles  of  t = 100  hours  each 


-[a 


886,62  r _ „ ,, 


Case  3 4 cycles  of  t = 50  hours  each 

- [asc^irlo]'' 

Case  4 8 cycles  of  t = 25  hours  each 
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TABLE  4.  .1.  Questionnaire  Data  Points 


Time  (t) 

Test  Strength  (TS) 

I, 

168 

.09257 

2 

168 

. 02900 

3 

100 

.05696 

4 

96 

. 05479 

5 

96 

. 50000 

6 

48 

.02805 

7 

17.07 

.01013 

Case  5 16  cycles  of  t = 12.  5 hours  each 


TS  = 1 


886,62  1 
886.62  + 12.  5j 


16 


0.201 


While  obviously  more  costly,  the  large  cycles  have  slightly  better  TS.  Clearly 
the  upper  limit  of  TS  obtainable  by  infinitesimal  lengths  t of  an  infinite  number 
of  cycles  is,  for  power  applied  for  total  tinie  T, 

1 -T/886.62 

1 - e 


Thus,  since  the  worst  case  is  - 1 which  has 


TS  = 


T 

T + 886.62 


f 


then  the  difference 


(l-e-T/«86.62^ 


I 

\^T  + 886. 62^ 


represents  the  total  possible  improvement  in  TS  for  fixed  total  time  T. 


In  the  preceding  example  this  difference  is  on  the  order  of  0,  201  - 0. 184  = 0.017 
which  hardly  seems  worth  the  trouble  of  using  Nc>  1. 

4. 1.  2 Test  Strength  (TS)  for  Equipraent/System  Level: 

The  BMD07R  computer  program  (described  in  the  appendix)  was  used  again  to 
find  the  parameter,  c,  in  the  functional  equation  TS  = t/(tH  c).  TS  (test  strength) 
was  computed  fi'om  the  data  points  u.sing  the  formula  TS  = 1. 0 - (^Initial/®  Final)- 

Eighteen,  and  finally,  sixteen  values  of  time  (t),  MTBF  initial  and  iinal  (Or,  Gp) 
from  the  internal  data  base  (see  Table  4, 2)  were  used,  along  with  an  initial  esti- 
mate of  c = 5000.  0.  Tills  allowed  the  iteration  scheme  to  converge  in  eight  steps 
to  c = 4084.  8 and  c = 4066.  5,  respectively.  The  SDO  model  uses  c'  = 3049. 875  == 
(0.  75)  (4060.  5)  in  order  to  "factor  out"  the  probability  of  detection,  That  is, 
the  SDO  model  uses  TS  - t/(t  + c'/Pfi)  because  it  separates  SS  and  Pd. 
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TABLE  4.  2.  Intemal  Data  Points 


Time 

^Initial 

®Fmal 

Test  Strength 

1 

4000 

150 

300 

.5000 

2 

5000 

50 

100 

. 5000 

3 

1689 

42 

98 

.5714 

4 

1690 

92 

216 

.5741 

5 

4200 

14 

148 

.9054 

6 

15000 

10 

29 

,6552 

7 

4502 

.6 

17 

.9647 

8 

16491 

80 

192 

, 5417 

9 

5986 

134 

456 

. 7061 

10 

14006 

283 

581 

. 5129 

11 

10339 

182 

233 

.2189 

12 

4312 

17 

54 

.6852 

13 

15519 

231 

251 

.0797 

14 

5537 

8 

17 

. 5294 

15 

12100 

6 

22 

. 7273 

16 

6100 

71 

126 

. 4365 

The  Reliability  Growth  Study  (ref.  47)  provided  eighty-one  triples  of  time  t,  Pi 
(Duane  logarithmic  growth  rate)  and  P2  (Duane  intercept  parameter)  for  In- 
house  ground  (thirty -one  points)  and  in-house  airborne  (fifty  points)  systems. 
Sixty-three  of  these  points  were  used  in  a .subsequent  analysis  (see  Section  4.3) 
with  the  IBM  model  and  are  shown  In  Table  4. 3.  Using  this  data,  the  test 
btreiiglhiS  wei'c  cuiiiputed  froiu  the  above  formula  and  ^I'inal 

computed  using; 

Oj  = P2  * r[(i.o/pi)  + 1.0] 

and 

Using  initial  estimates  of  the  parameter  c,  the  iteration  converged  to  c = 260.  06 
tor  the  airborne  data;  c = 916.  3i  for  the  ground  data,  and  c = 357. 10  for  the 
ground  and  airborne  data  combined. 

In  order  to  sec  if  test  strength  could  be  written  as  a function  of  several  variables, 
the  Multiple  Linear  Regression  (MLRG)  subroutine  (described  in  the  appendix) 
was  used.  With  test  strength  (TS)  as  the  dependent  variable,  various  combina- 
tions of  time,  parts  count,  and  environmental  conditions  were  tried  as  independ- 
ent variables.  In  all  ca.scs  11^,  the  coefficient  of  multiple  determination,  was 
very  small  (see  Table  4.4). 

The  value  c = 40G6.  5 was  used  because  the  intemal  data  base  provided  the  best 

m. 
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TABLE  4.3,  Reliability  Growth  Data 


Time 

^Initial 

®Final 

TS 

Y' 

1 

3038 

330.63 

1781.5 

. 81441 

. 77819x10^ 

2 

3822 

452. 02 

2030.5 

. 77739 

. 22781x10“® 

3 

6369 

44. 516 

362. 86 

.87732 

, 28907x10^ 

4 

3822 

131.49 

254, 52 

.48339 

,64664x10 

5 

1122 

30. 115 

35.  344 

. 14794 

. 45780x10“^ 

6 

2700 

. 099636 

62.614 

.99841 

. 68262x10“^ 

7 

3200 

.41363 

67.855 

.99390 

. 37012x10"^ 

8 

3700 

3.  6481 

142. 88 

.97447 

, 88842x10“"* 

9 

3700 

1.0919 

308.20 

.99646 

. 41420x10“^ 

10 

2500 

77.812 

204. 56 

.61961 

. 27362x10"^ 

11 

2193 

23.643 

228.75 

. 89664 

. 58012x10“® 

12 

2248 

43. 723 

81,398 

,45285 

, 22290x10^ 

13 

3415 

,60827 

13. 321 

.95434 

. 12416x10® 

14 

4659 

430.02 

1150.4 

. 62019 

. 27249x10"'^ 

15 

6144 

196.60 

337. 75 

.41793 

.15031x10® 

IG 

4467 

8.0679 

1 

172. 94 

.95335 

. 22948x10"^ 

17 

2043 

29. 593 

336. 10 

.91195 

, 10984x10"® 

18 

2792 

234.62 

360.44 

. 34908 

. 85282x10"® 

19 

1540 

14.205 

39.810 

.64317 

, 12821x10“'^ 

20 

1726 

3.  5269 

726. 54 

. 995X5 

. 83703x10"® 

21 

2261 

3.0704 

215.75 

.98577 

,38257 

22 

3105 

766.40 

3595.0 

. 78681 

. 12800x10^' 

23 

3415 

4. 7866 

74. 381 

.93.565 

. 74311x10^ 

24 

4536 

3. 7041 

123.07 

. 96990 

, 16717x10^ 

25 

4536 

310.54  ' 

548.30 

. 43364 

. 34030x10^ 

-30 

2G 

2076 

69.100 

202.04 

. 65799 

.13173x10 

27 

5085 

29. 501 

128.74 

. 77085 

. 33722x10® 

-15 

28 

1122 

24. 439 

36.220 

. 32525 

.30769x10  ^ 

29 

1400 

22.  2.56 

61. 352 

. 63724 

. 18048x10^ 

30 

400 

22.892 

75.951 

.69859 

..  58302x10^ 

31 

1200 

7. 3325 

106.40 

. 18408x10“® 

32 

4988 

4.2615 

44. 205 

.48216x10® 
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TABLE  4,  3.  Reliability  Growt;h  Data  (Continued) 


Time 

^Initial 

®Ftnal 

TS 

y 

33 

1000 

.92606 

47. 765 

. 9806>. 

. 13708x10’'^ 

34 

2176 

.027881 

11.465 

.99757 

.11321 

35 

400 

2.4662 

24. 715 

.90022 

, 15516x10^ 

36 

1300 

1.0681 

65.495 

.98369 

. 92072x10"^ 

37 

4996 

36.735 

95.991 

.61730 

. 21104x10^ 

38 

1200 

41.069 

167.65 

. 75504 

. 12586 

39 

536 

96. 734 

116. 72 

. 17123 

, SeGGSxlO"^ 

40 

500 

21.399 

88. 647 

. 75860 

, 15739 

41 

760 

8.8171 

183.88 

.95205 

. 14099 

42 

1400 

31. 520 

61. 006 

.48333 

. 11316 

43 

800 

29. 775 

74. 712 

. 60148 

. 12527 

44 

760 

32.189 

213.28 

. 84908 

. 12449 

45 

782 

39.047 

202.26 

. 80694 

.17877xl0~^ 

46 

767 

17.226 

125.43 

.86267 

, 57691x10"^ 

47 

760 

25.414 

125. 13 

. 79690 

.22788x10^ 

48 

782 

33. 681 

301. 72 

. (38837 

. 50858 

49 

760 

7.0105 

82. 785 

,91532 

. 26110 

50 

782 

9.4446 

106. 30 

.91115 

, 22573x10"^ 

51 

767 

5.4092 

108.96 

.95036 

. 25400 

52 

2500 

1.5325 

73.877 

.97926 

. 48286xl0~^'^ 

53 

798 

.25120 

1 

14.433 

. 98260 

. 16778x10'’^ 

54 

1097 

,60820 

14. 040 

.95668 

. 40146 

55 

399 

. 33733 

11.201 

.96988 

. 13968x10^ 

56 

1192 

.12900 

5. 5837 

.97690 

.37987x10"^ 

57 

2500 

. 84153 

11. 323 

.92568 

. 14334x10"^^ 

58 

760 

1. 12714 

62. 248 

.97958 

. 32929 

59 

500 

6.5611 

41.867 

. 84329 

.28217x10^ 

GO 

767 

6,4641 

85. 624 

.92451 

.56011x10“^ 

61 

782 

6. 0595 

89,320 

,93216 

. 32853x10“^ 

62 

766 

5.9670 

40.514 

. 85272 

.21182 

63 

549 

6.9464 

16.115 

. 56896 

. 16692 

Note:  Numbers  1-28  represent  the  ground  data. 

Numbers  29-63  represent  the  airborne  ilata. 
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TABLE  4.4,  Test  Strength  as  a Function  of  Several  Variables 


Independent  Valuables 

2 

R = Coefficient  of  Multiple  Determination 

Environmental  Conditions, 
Parts  Count,  and  Time 

1. 72927x10“^ 

Parts  Count  and  Time 

9.  75238x10''^ 

Environmental  Conditions 
and  Time 

1.  58463x10"^ 

Time 

6.47496x10"^ 

4, 2 Test  Strength  for  Constant  Temperature,  Temperature  Cycling,  Vibration,  and 
Combined  Screens 

The  equations  utilized  for  these  screens  were  developed  using  Arrhenius  rela- 
tions and  were  taken  from  the  Hughes  Aircraft  Company  CREDIT  report  (ref  42). 

Test  strength  for  k combined  screens  is  defined  asTS  = 1 - (l-TS^.  That 

is,  total  test  strength  is  the  probability  the  defect  is  detected  on  at  least  one  of 
the  screens  which  is  one  minus  the  probability  it  is  not  detected  on  any  of  the 
screens. 

Five  types  of  screens  are  provided  in  the  model:  the  two  power  screens  pre- 
viously discussed  and  temperature  cycling,  constant  temperature  and  vibration, 
If  a particular  screen  is  not  used  its'  TS  defaults  to  0, 


TSl  (consfcmt  temp)  = 

TS2  (cycled  temp)  = 

TS3  (vibration)  = 

where  N 


Lo.6  X P 


0.8  X P. 


1-e 


-N  X tj,  X 2.  63  X 10  ‘ X e 


^ 0.0122(T^  + 273) 


dT 


1 -c 


. .0122(T  + 273) 

-N  X T-*  X 11.  835  X 10  X e 
^t 


0.2  X P 


1-e 


. j ^ »»  rt  __  __  _ 

"iN  A g A A I , O;?  A iU  A V 


d 

number  of  cycles 


. 0122  (T  + 273)1 1 

JJ 


t,j,  = time  of  temperature  ejqmsure  (hours) 


= actual  temperature  (^C) 


= rate  of  temperature  change  (^C/mlxi) 

^dt  ■*  ~ 50)/2  (^^C) 
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where  g -=  vibration  (g' s)  (sinusoidal  at  nonrtjsonant  frequency) 

. ' \ length  of  vibration  (hours) 

= jtemp  at  vibration -25 1 h 25  (^C) 

The  constants  used  are  derived  parameter  values  for  cards  containing  miscel- 
laneous parts,  with  the  exception  of  0.  75  which  is  the  default  of  used  in  the 
definition  of  test  strength.  No  "model"  was  available,  anywhere,  for  P(j.  The 
value  0.  75  is  the  best  number  available  based  on  Hughes  internal  ejq)erience. 

4.  3 Conversion  of  MTBF  (6)  to  Defects 

Several  metliods  were  tried  in  order  to  convert  MTBF  to  defects.  The  recom- 
mended metliod  is  described  in  Section  3.  5.  In  this  section  we  describe  other 
methods  which  were  not  successful.  The  multiple  linear  regression  (MLRG) 
suJ^routine  (described  in.  the  appendix)  was  used  to  write  the  dependent  variable 
Y = OMR/Part  Count  as  a function  of  the  independent  variables,  MTBF  final  and 
MTBF  predicted.  Iii  each  case  R^,  the  coefficient  of  multiple  determination, 
was  very  small.  Eighteen  values  of  the  Internal  data  were  used,  producing  the 
results  with  Y as  defined  above: 


Independent  Variable 

R^' 

G Final,  0^, 

5.98614  X 10~2 

6 Predicted,  Gp 

7.18709  X 10“^ 

CURFIT,  a least  squares  curve  fit  program  (described  in  the  appendix),  was 
implemented  using  Y = OMR/Part  Coimt  as  the  dependent  variable  versus  the 
independent  variables  of  ypinab  0 predicted-  Also,  Y = OMR  w'as  used  as 

a dependent  variable  versus  the  same  independent  v^ariables  as  above.  The 
data  points  used  came  from  the  internal  data  values.  The  results  in  Table  4,  5 
show  that  the  coeffi  cient  of  multiple  determination  was  very  small  for  aJ.1  equa- 
tion types. 

Data  values  from  the  "Reliability  Growth  Study"  (ref.  47)  IBM  model,  "hi-house" 
ground  and  airborne  systems  were  combined  with  corresponding  ones  from  the 
Duane  model  (refer  to  Table  4. 3)  to  produce  sixty -three  points  that  were  used  in 
the  CURITT  program.  The  dependent  variable  Y'  = e~K2^  = P2e"^^^^  (P2  and 

P3  are  the  computer  codes  used  in  ref.  47)  and  the  independent  variable  Ojr  was 
computed  from  the  Duane  model.  The  IBM  model  gives;  Cumulative  number  of 
correctable  failures  at  rernainma  time  t - Kxe"^2t.  Obviously  (when  t = 0) 
is  the  initial  number  of  defects  present  and  K2  is  a "removal  rate.  " Thus  at 
program  end  (i.c.,  at  deUvery  time)  t^,.  Y'  = K^e"^2tF  is  D^,. 

Again,  the  coefficient  of  multiple  determination  was  very  small  when  it  could 
be  computed,  us  Table  4,6  .shows  tliat  there  was  no  fit  possible  for  four  of  the 
six  cur/e  types. 

The  poor  results  caused  us  to  abandon  this  approach  to  converting  e to  defects. 
The  approach  adopted  is  given  in  Suction  7> . 5 , 


‘i  i-uni.r-,. 


38 


TABLE  4.  5.  Conversion  of  MTBF  to  Defects  Using  Internal  Data 


= X./(A+BX^  0. 127914  -6983.29  449.607  3.88004x10  4249.08  307,629 


TABLE  4. 6.  Conversion  of  MTBF  to  Defects  Using  Reliability  Growth  Data 


Curve 

Type 

Y'  = K,e“*^2*  versus  G„.  , 

1 Final 

Index  of 
Determination 

A 

B 

Y = A+BX 

* 

* 

* 

y = Ae®^ 

6,70122x10”^ 

6.82998x10"^ 

-2, 19542x10"^ 

Y = AX® 

1.35703x10"^ 

0.321833 

-1. 32986 

Y = A+B/X 

* 

♦ 

* 

y = 1/(A+BX) 

* 

* 

Y =X/(A+BX) 

+ 

* 

*No  fit 
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4.4 


Cost  Data  and  Cost  Equations 


Cost  data,  as  was  previously  mentioned,  was  obtained  from  the  Hi;ghes  Aircraft 
Company  manufacturing  departments  of  the  Fullerton  and  Fl  Segundo  sites. 

It  was  decided,  due  to  the  instability  of  the  dollar,  to  use  man-hours  as  the 
basic  unit  of  the  cost  data.  Tliis  data  was  obtained  by  engineering  estimates 
of  a "typical"  card,  unit,  equipment,  and  system  man-hour  usage  of  the  five 
screening  techniques  addressed  in  this  report,  i.  e. , constant  temperature, 
cycled  temperature,  vibration  and,  constant  and  cycled  power. 

Rework  cost  data  was  also  given  by  engineering  estimates  of  the  cost  Involved 
as  well  as  an  estimate  of  number  of  defects  caught  by  each  rework  cycle  at 
"typical"  card/unit  and  equipment/system  levels. 

The  basic  cost  equation  is  of  a linear  nature  where  total  cost  = fixed  cost  + 
(variable  cost  x duration  of  test).  The  default  used  for  ftxed  cost  In  the  SDO 
model  is  zero  due  to  the  assumption  that  test  equipment,  etc. , are  already 
available  to  the  user.  The  two  defaults  of  the  variable  cost  are  derived  from 
the  cost  data  obtained  at  t d/unlt  and  equipment/system  levels  respectively. 

The  cost  equations  derived  for  the  following  screens  given  for  1)  card/unit 
levels,  and  2)  equip/system  levels:* 

Constant  Temperatui'c;  , ■ 

1.  Test  Cost  -•  Fixed  Cost  + Bl  .x  Test  Time  (man-hours) 

2.  Test  Cost  = Fixed  Cost  + B2  x Tost  Time  (man-hours) 

Cycled  Temperature: 

1.  Test  Cost  = Fixed  Cost  + Bl  x Difference  in  Temp  Extremes  x Rate  of  Temp 
Change  x Number  of  Cycles 

2.  Test  Cost  = Rxed  Cost  + B2  x Difference  in  Temp  Extremes  x Rate  of  Temp 
Cliangc  X Number  of  Cycles 

V ibration: 

1.  Test  Cost  = Fixed  Cost  + BX  x Duration  of  Vibration  x Number  of  Cycles 

2,  Test  Cost  = X''ixed  Cost  + B2  x Duration  of  Vibration  x Number  of  Cycles 

Constant  Power; 

1,  Test  Cost  = Fixed  Cost  + Bl  x Duration  of  Power  Applied 

2.  Test  Cost  = Fixed  Cost  + B2  x Duration  of  Power  Applied 

*The  constants  Bl  and  B2  represent  the  average  labor  hours  per  hour  of  test  in  the  de- 
fault option  for  momtoring  and  data  collection.  The  default  values  are  0. 15  and  1.0 
respectively  and  the  fixed  costs  are  zero. 
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Cycled  Power: 


1.  TestCost=  Fixed  Cost + Blx  Duration  of  Power  Applied  X Number  of  Cycles 

2.  TestCost  = Fixed  Cost + B2x  Duration  of  Power  Applied  x Number  ofCycles 

Where  time  is  given  in  hours  and  temperature  is  given  in  '^C. 

Rework  costs  are  an  integral  part  of  tlie  total  cost  considerations,  rework' s 
purpose  being  to  correct  those  defects  discovered  by  the  screens.  It  is  a cost 
that  must  be  incurred  as  an  alternative  to  discarding  in  that  "new"  inputs  to  a 
system  may  contain  the  same  defects  as  a "rework"  if  not  more.  The  following 
table  represents  the  man-hours  required  to  rework  at  card  and  higher  assembly 
levels  the  defects  discovered  at  card,  unit,  equipment,  and  system  level  as 
obtained  frcm  the  survey  and  Hughes  internal  data. 

TABLE  4.  7.  Man-hours  Per  Defect 


Rework  Man-Hours  per  Defect 


Rework  Location 

Card 

Unit 

Equip 

System 

Card  Level 

.5 

9.46 

51.  5 

'63.0 

Higher  Assy  Level 

•1 

3.67 

45.5 

57.0 

5 Determining  Relationship  of  Number  of  Subco’  'actors  and  Percent  Non-Standard 
Parts  to  Test  Strength 

To  determine  any  relationsMp  between  Test  Strength  (TS)  and  number  of  sub- 
contractors and  percent  non-standard  parts,  a requirement  of  the  work  state- 
ment, the  computer  program,  CURFIT,  described  in  the  appendix,  was  imple- 
mented with  data  points  from  the  internal  data.  TS  = 1.  0 - (0j/0p)  was  used  as 
the  dependent  variable  versus  the  independent  variables  of  number  of  subcon- 
tractors and  percent  non-standard  parts.  The  results  shown  in  Table  4.  8 indi- 
cate tliat  the  index  of  determination  was  not  very  large  in  any  of  tlie  curve  fitting 
cases. 

The  BMD07R  computer  program  (described  in  the  appendix)  was  used  to  find 
the  parameter,  c,  in  the  functional  equation  TS  = s/(s  i c),  where  s ==  the  num- 
ber of  subcontractors.  Sixteen  data  points  from  the  internal  data  were  used 
with  an  initial  estimate  of  c = 10.  0 which  allowed  the  iteration  scheme  to  con- 
verge in  eight  steps  to  c = 3.  b(  This  last  analysis  also  showed  no  correlation 
between  'J’S  and  subcontractors. 
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TABLE  4.  8,  Determining  RjlalLonship  of  Non-Standard  Parts  and  Number  of  Subcontractors  to  Test  Strength 


SECTION  5.  0 - COST/STHENGTIl  ATODEl.S 


5.  1 Manufacturing  Process 


From  a product  reliability  point  of  view,  the  manufacturing -assembly-test 
process  can  be  viewed  as  a "machine"  for  identifying  and  removing  hardware 
defects  that  arc  induced  through  the  use  of  defective  parts  (resistors,  capaci- 
tors, ICs,  etc.),  poor  designs  and  assembly  errors.  This  machine  can  be 
effective  by  removing  a large  number  of  defects  at  a reasonable  cost,  or  ineffec- 
tive by  removing  only  a small  number  of  defects  at  a high  cost  and  not  meeting 
product  reliability  requirements  imposed  by  the  customer. 


Figure  5.  1 represents  the  various  levels  of  assembly  and  test/rework  stations 
at  each  level  of  a generalized  manufacturing  process.  The  process  is  cyclic  in 
the  sense  that  defects  that  are  "caught"  by  a particular  test  may  not  be  corrected 
(and  removed  from  the  process)  but  instead  would  go  back  into  the  process 
incurring  additional  test  and  rework  costs.  The  symbols  used  to  identify  the 
process  are  defined  below: 


A. 

.1 


jk 


PDEF 


ADEF. 

] 


Q 


ijk 


j ' assembly  level 

k^^  test  of  assembly  level 

Inspection/verification  station  for  test  of  assembly  level 
Quantity  of  part  defects  initially  present 

til 

Quantity  of  assembly  defects  initially  present  at  the  j ” level 

Number  of  defects  present  at  the  shirt  of  the  test, 
assembly  level,  during  the  test/rework  cycle. 

Probability  of  passing  a defect  from  the  test  to  the  k + 
test,  jtk  assembly  level  during  the  test/rework  cycle. 


F 


ijk 


Elijk 


k2iiE 


1 - Qijg  = joint  probability  of  raising  a defect  to  a detectable 
level  and  detecting  the  defect  with  the  test  equipment  employed 
at  the  k^k  test,  jtk  assembly  level,  during  the  ilk  test/rework 
cycle. 

Fraction  of  the  time  a defect  results  in  test/rework  at  the 
"card"  assembly  level  (i.  e.  , at  j=l).  The  remaining  portion 
of  the  time,  1 - Fjjg,  defects  are.  tested/ reworked  at  the  j^h 
assembly  level. 

I'robability  that  a defect  detected  at  ttiC  k^k  test,  j^^  assembly 
level,  during  the  ilk  cycle  is  corrected  (and  removed  from 
the  process)  during  rework  at  the  j*^k  card  level. 

Probability  that  a defect  detected  at  the  k^k  test,  j^k  assembly 
level,  during  the  i*^k  cycle  is  corrected  (and  removed  from  the 
process)  duiing  rework  at  the  j^k  assembly  level. 
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Generalized  Manufacturing  Assembly  — Test  Rework  Process 


Thus,  at  the  first  cycle  (1-1)  of  test  station  Tjj^,  Xijk  defects  (part  and  assembly 
defects  that  were  not  caught  in  the  previous  tests)  are  tested  (stressed). 

Qljk  Xijij  defects  are  not  caught  and  are  passed  on  to  the  next  test  and  Pijk  ^Ijk 
defects  are  detected  and  sent  to  the  Ijj^^  inspection  station  (for  determination  of 
defect  type;  card  level  or  assembly  level).  Fijk  Pijk  Xijk  result  in  card  level 
rework  and  (1  - Fj^jk)  Pljk  ^Ijk  result  in  assembly  (jth)  level  rework.  Of  the 
number  of  defects  resulting  in  card  level  rework,  Rlijk  Fljk  Pjjk  ^Ijk  will 
actually  be  corrected  and  removed  from  the  process  and  (1  - Hlfjk)  r ijk  ^Ijk 
Xijk  will  not  be  corrected.  A similar  breakdown  of  defects  exists  for  assembly 
level  rework.  At  the  next  cycle  (i  = 2),  the  number  of  defects  entering  the  Tjk 
test  station  (i.  e,  , X2jk)  is  given  by: 

' «2ik  *2)U-1  " Pljk  ^Ijk  <1> 

The  first  term  on  the  right  side  of  (1)  represents  defects  passed  by  the  previous 
test  on  the  second  cycle  and  the  second  term  represents  the  assembly  (jth  level) 
defects  that  were  not  removed  from  cycle  1. 

The  general  equations  representing  the  entire  manufacturing  process  are  given 
in  Figure  5.  2.  The  equations  arc  recursive  with  initial  conditions  as  shown.  A 
computer  routine  was  developed  to  solve  these  equations  and  is  provided  as  a 
subroutine  (SCREEN)  in  the  Screening  and  Debugging  Optimization  (SDO)  model. 
The  solutions  |Xiijk}jk  provide  the  number  defects  present  at  the  start  of  the 
nth  cycle  for  test  stations  jTjk|  jk  so  that  for  a given  set  of  tests,  the  test 
strength  TS  is  given  by; 


TS 


1 


D 

D 


F 

1 


(i!) 


where; 


D 


1 


U 


F 


M 

PDEF  + ADEF;  (incoming  defects) 


NCYC 


S 


nM  N(M)  riM  N(M) 


(outgoing  defects  - i.  e.  , 
number  remaining  in  the 
system) 


PDEF  = number  of  part  defects 

ADEF.  = number  of  assembly  defects  introduced  at  the  assembly 
level 


M - number  of  assembly  levels 


NCYC  = maximum  number  of  process  cycles 


^nM  N(M) 
^nM  N(M) 


probability  of  passing  a defect  at  final  tost  (N(M))  of  final 
level  of  assembly  (M)  during  the  nth  cycle. 

number  of  defects  present  at  the  N(M)th  test,  assembly 
level  daring  the  cycle. 


4G 


The  corresponding  cost  function  (TCOST)  representing  the  total  test  and  rework 
costs  incurred  during  NCYC  cycles  is  given  by: 

NCYC  M N(j) 

n§  ^ “ ‘^njk)  \jk] 


- test  cost  for  conducting  test 
= CRlji^  F|jj^  + CR2j{^  (1  - Fijid 

= rework  cost  per  cycle  for  defects  identified  Cor  card  level 
rework  at  the  Ijj^  inspection  station. 

- rework  cost  per  cycle  for  defects  identified  for  assembly 
level  rework  at  the  Iji^  inspection  station. 

Other  terms  are  as  defined  previously. 

The  manufacturing  process  represented  by  Figure  5. 1 identifies  the  test  stations 
(Tjk)  at  each  level  as  separate  events.  The  purpose  of  this  separation  is  to 
compare  test  atiangths  and  associated  costs  of  individual  screens  as  required 
for  screen  optimization  (described  in  the  next  section).  However,  in  actual 
practice,  most  testing  at  the  same  level  of  assembly  is  conducted  in  parallel, 
llms,  temperatuie  cycling,  vibi  ation  and  power  cycling  may  bo  used  in  a 
combined  test  (e.  g. , Test  Level  E of  MIL-STD-781B). 

It  is  generally  felt  that  a combined  test  applies  more  stress  on  a unit  than  when 
the  same  tests  are  conducted  separately  because  of  the  stress  interactions. 
However,  no  information  from  the  literature  search  or  from  internal  data  was 
found  to  support  this  contention,  and  therefore,  tlie  test  strengths  used  do  not 
reflect  any  stress  interaction.  ITie  resulting  effect  of  not  including  this 
additional  stress  of  a combined  test  is  a more  conservative  solution. 

In  addition,  the  manufacturing  process  assumes  that  defects  which  are  not 
removed  during  a given  rework  cycle  are  (1)  introduced  back  into  the  same 
test  if  classified  to  be  an  asserribly  level  defect,  or  (2)  pul  back  into  the  first 
test  if  classified  to  be  a card  level  defect,  'fhis  is  the  baseline  manufacturing 
policy  chosen  for  the  study.  An  alternate  policy  commonly  used  Is  to  pass 
defects  to  the  next  test  in  sequence.  In  this  way,  defects  that  are  caught 
at,  say,  test  station  Tj)^^  and  which  arc  not  removed  at  assembly  level  rework 
would  not  return  to  test  station  l-jk.  but,  instead,  to  lest  station  Tjkn  ] . Only 
minor  changes  in  the  process  cquation.s  (.Figure  .5.2)  arc  needed  to  represent 
this  type  of  testing  policy.  Accordingly,  Figure  .5.  3 gives  the  corresponding 
equations  with  the  necessary  changes. 

. 2 Ot:itimizati(ni  Algorithm 

An  optimization  algorithm  ha.s  been  developed  to  .solve  two  related  problems  in 
the  use  of  scrcening/debugging  tests  to  reduce  the  number  of  p;irt  and  manu- 
facturing a.ssembly  defects.  Brietly  .stated,  tlie.se  two  jiroblems  are:  (i)  how 
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Figure  5.3.  General  Manufacturing,  Process  F.quations  (Alternate  Retest  Policy) 


to  remove  a given  number  ot  hardware  defects  (bad  parts,  assembly  errors, 
design  errors,  etc. ) in  the  manufacture,  of  a system  at  a minimum  total  cost, 
and  (2)  given  a fixed  ''not-to-excced"  dollar  budget,  what  screening  tests  should 
be  conducted  to  minimize  the  number  of  defects  getting  into  the  final  system. 

Unless  a manufacturer's  resources  are  severely  constrained  with  respect  to 
testing  facilities  or  the  product  being  manufactured  is  of  a simple  nature  (e.  g,  , 
a single  level  of  assembly),  the  solution  to  (1)  or  (2)  is  not  an  easy  one.  The 
manufacturer  not  only  has  a choice  of  various  types  of  tests  (power  conditioning, 
temperature  cycling,  vibration,  etc. ) and  severities  (duration  of  test,  tempera- 
ture extremes,  vibration  amplitude,  etc, ) but  must  choose  where  to  place  his 
test  selections  in  the  manufacturing  assembly  process.  For  example,  in  a 
situation  where  there  are  three  types  of  tests,  each  one  of  which  has  three  test 
parameters  and  a selection  ol  five  values  for  each  parameter,  and  any  combina- 
tion of  the  three  tests  can  be  conducted  at  four  different  levels  of  assembly 

(e.  g.  , card,  unit,  equipment  and  system),  then  there  would  be  a total 
586  4x10^5  possible  test  sequences,  one  of  which  would  be  optimal. 

A given  test  sequence  is  considered  to  be  better  (more  optimal)  than  another  if 
it  provides  the  same  or  higher  screening  strength  at  a lower  cost,  or  for  the 
same  or  lower  cost  it  provides  a higher  screening  strength.  The  measures 
used  in  this  algorithm  to  determine  optimality  are: 

TS  = (total  defects  removcd)/(total  defects  introduced) 


TC  s (average  cost  per  removed  defect) 

Figure  5.4  outlines  the  computation  procedure  for  the  algorithm.  The  SDO  model 
provides  a selection  of  five  test  types  (constant  temperature,  temperature  cycl- 
ing, vibration,  power  continuous  and  power  cycled)  and  four  assembly  levels 
(card,  unit,  equipment,  system).  The  number  of  test  parameters  are2,  4,  4,  1,  2 
for  tests  1 through  5,  respectively,  and  the  maximum  number  of  steps  (values)  for 
each  parameter  have  been  set  at4  (including  the  parameter  values  which  eliminate 
the  test).  Thus,  the  total  number  of  test  sequence  combinations  possible  for  the 
maximum  case  Is: 
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test  'I'll  is  combined  with  test  812  to  form  the  sequence 
defined  a.s  follows; 


= TS  ((,  3)  11  - TS  ((-1,  i)]  f TS  (f-1,  i)  (1) 

v^  = TC  (f,  j)  TS  (^,  j)  1 1 - TS  (f-1,  1)]  i TC  (f-1,  i)/(  (2) 

for  i = 1,  . . . , 4^  (combinalions  of  'J'31)  and  j = 1 4^  (combinations  of 

Ti2)-  This  sequence'  is  ranked  from  lowc.sl  to  highe.sl  cost  (v/;)  and  a dominant 
sequence  is  formed  by  removing  combinations  in  which  the  test  strength  (up)  is 
lower  than  the  preceding  combination  (i.  e. , u^<,  u^..!).  "J'he  dominant  sequence 
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Figure  5.4.  Computation  Procedure  for  the  Optimization  Algorithm 


formed  in  this  way  (say  [u|,  v’^,  ] ) provides  the  input  necessary  for  the  next 
step,  i.  e, , ^ 

TS  (hi,  i)  = 

and  TC  (f-1,  i)  = 

This  dominant  sequence  is  then  combined  with  T13  according  to  equations  (1) 
and  (2)  above  to  form  the  next  sequence.  The  procedure  is  continued  until  all 
test  combinations  have  been  exhausted.  The  final  dominant  sequence,  say 
fu#f,  v^f],  is  therefore  optimal  in  the  following  sense; 

1.  If  m>n  then  u^  and  v^  > v^  (i.  e. , the  sequence  is  monotone  never 
decreasing  in  both  u^  and  v^) 

2,  If  (u',  v')  represent  the  test  strength  and  cost,  respectively,  of  any  other 
sequence  of  tests  which  docs  not  belong  to  (u^,  v^^],  then  there  is  a test 
sequence  that  does  belong  to  [u^,  v^]  which  dominates  (u',  v'). 

The  successively  larger  number  of  test  sequence  combinai^ions  produced  at  each 
step  can  also  be  reduced  by  eliminating  terms  from  the  dominant  sequences  that 
are  too  close  to  matter.  For  example,  costs  and  test  strengths  that  differ  by 
less  than  one  percent  could  be  removed  and  would  not  appear  in  a dominant 
sequence.  This  would  not  produce  a "pure  optimum'  solution  but  would  produce 
a practical  "near  optimum"  solution. 

Figure  5.  5 gives  a flow  diagram  of  the  optimi^i^.ation  procedure.  The  procedure 
has  been  computerized  (written  in  FOHTHAN  IV)  for  processing  on  an  IBM 
3G0/370  computer  and  consists  of  a MAIN  c.alling  routine  and  six  subroutines 
v/hich  are  defined  as  follows; 

DATA  — This  subroutine  reads  and  writes  all  input  data  with  the  exception  of 
individual  test  cost  parameter  values  which  are  read  in  for  each  test  in  the 
MAIN.  Default  values  for  most  parameters  arc  also  defined  in  the  event  no 
user  data  is  available. 

SSPROB  - This  subroutine;  (1)  calculates  the  screening  strength  probabilities 
of  each  of  five  tests  as  a function  of  test  parameter  values,  (2)  calculates  single 
cycle  tost  strengths  (Fijk  values  of  the  previous  topic)  based  on  test  equipment 
detection  probabilities  and  tlie  screening  strength,  and  (3)  calculates  test  cost 
based  on  the  duration  of  the  test. 

SCREEN  — This  routine  modeds  the  manufacturing  process  and  calculates  the 
total  test  strength  and  cost  of  a specified  test  sequence. 

RANK  — This  routine  ranks  a given  set  of  test  combinations  by  cost  from  lowest 
to  highest. 

SEARCH  — This  routine  searches  through  the  optimal  sequence  for  the  combina- 
tion that  satisfies  the  specified  requirement  (i.  e.  , MTBF  requirement  or  fixed 
cost  requirement), 

REPORT  — This  routine  decodes  the  selected  test  sequence  into  the  original  test 
parameter  values  and  writes  an  output  report  which  (1)  identifies  each  test  and  test 
parameter  value,  and  (2)  summarizes  the  co,st  lor  each  test  and  level  of  assembly. 
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SECTION  G.O  - PROCEDURES  AND  EXAMPLES 


6. 1 Procedure  for  Using  the  SDO  Model 


Data  Input  Requirements  and  Fall-back  Options 


In  order  to  operate  the  SDO  model,  certain  input  data  requirements  must  be 
provided.  Some  data  must  be  provided  by  the  user  such  as  an  estimate  of  the 
system  failure  rate  (e.g.,  based  on  a handlx)ok  prediction),  the  customer 
required  failure  rate  and  system  complexity  (part  count).  Other  data  is  option- 
ally provided  by  the  user  with  a default  to  SDO  model  supplied  values  based  on 
study  findings.  Table  G.l  summarizes  the  data  requirements,  parameter 
symbol,  computer  input  format,  units,  source  and  fail-back  option.  The  follow- 
ing paragraphs  describe  the  data  requirements  and  parameters  in  more  detail. 

Test  Characteristics 

The  test  cost  function  has  the  form:  CT  - A1  + (Bi)  (HOURS)  where  A1  and  B1 
are  the  fixed  and  variable  costs,  respectively,  and  HOURS  represents  the 
duration  of  the  test.  CT  represents  the  total  cost  of  conducting  the  test  and  is 
expressed  in  dollars.  The  option  is  exercised  whenever  Bl  is  zero.  In  this 
case,  CT  is  expressed  in  hours.  The  option  on  fixed  test  cost  (Al  = 0.0) 
assumes  that  no  largo  capital  investment  in  test  equipment  is  needed  to  imple- 
ment any  of  the  test  sequences  being  considered.  The  option  on  variable  test 
costs  is  based  on  Hughes  experience  in  testing  at  various  levels  of  assembly. 

Screening  strength  (SS)  is  computed  automatically  using  subroutine  SSPROB  by 
evaluating  the  CREDIT  (ref.  42)  equations  for  screening  strength  at  selected 
points  of  the  test  parameters.  The  probability  of  detecting  a defect  (P^j)  with 
test  equipment  is  dependent  on  the  screen  used,  the  level  of  assembly  and  the 
number  of  test  rework  cycles.  P^j  is  an  ax’ray  defined  by.  Pd  = Pd  (I>  12)  where 

1<I<NCYC  cycles,  lsIl<M  assembly  levels  and  IsI2<5  tests.  If  any  value  of 
P^  is  zero,  the  default  to  P^  = 0. 75  is  exercised. 

The  parameters  of  each  test  are  sequenced  through  values  in  the  optimization 
process  described  in  the  previous  section.  The  minimum  and  maximum  limits 
for  each  test  parameter  are  optionally  specified  by  the  user.  These  limits  are 
denoted  by  AMINjj^  ar.d  representing  the  minimum  and  maximum 

limits  of  the  kth  parameter  of  the  jth  test.  The  standard  values  of  these  limits 
are  provided  by  the  SDO  model  as  default  values  in  the  following  table. 


Test  Parameter 

Type  of  Test 

Constant 

Temperature 

Vibration 

Constant 

Power 

Cycled 

Power 

Parameter  No.  1 

Temp  Extreme 

Upper  Temp 

G-  Level 

Time 

Time 

max 

YO^C 

70^C 

6 

168 

8 hours 

min 

-G5”C 

25^C 

1 

0 

0 hours 

Parameter  No.  2 

Test  Time 

Lower  Temp 

Time 

- 

Cycles 

max 

170  hours 

-50«C 

2 hours 

168 

min 

0 hours 

-250C 

0 hours 

- 

3 

Parameter  No.  3 

- 

Temp  Rise 

Temp 

- 

- 

max 

_ 

10®C/min 

25^C 

min 

- 

O^C/min 

23OC 

- 

- 

Parameter  No,  4 

” 1 

Cycles 

Cycles 

- 

- 

max 

- ; 

64 

64 

\ 

min 

10 

10 

- 

Manufacturing  Process  - Fixed  rework  cost  is  specified  as  a factor  of  the 
variable  rework  cost  which  is  furnished  by  the  user.  If  the  variable  rework 
cost  (B2  for  card  level  and  B3  for  higher  levels)  is  ^ero,  the  SDO  roodel  default 
is  exercised  as  follows: 


Manufacturing  Assembly  Level 


Location  of  Repair 

1 

2 

3 

4 

Card  level  (B2) 

0.6 

9.46 

51.  5 

63.0 

Higher  Assembly  Level  (13 .i) 

0.  1 

y.U7 

1 

4.6.  5 

57.0 

The  above  quantities  are  expressed  in  man-hours  and  are  averages  based  on  a 
wide  variety  of  card  and  assembly  types  (see  page  42). 

Fraction  defective  sent  to  card  level  repair  (F)  is  the  expected  fraction  of 
defects  occurring  at  higher  assembly  levels  which  ai’e  sent  to  the  card  level 


TABLE  6. 1.  Input  Data  Requirements/Options 


TABLE  G.  1.  Input  Data  Requirements /Options  (Continued) 
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**Thr8e  types  of  field  stress  are  provided  ; (1)  temperature  cycling,  (2)  vibration  and  (3)  power  on-off  cycling. 


for  repair.  All  other  defects  arc  repaired  at  the  assembly  level  in  which 
detection  took  place.  F is  a function  of  the  screen  used,  tlic  level  of  assembly 
and  number  of  test  rework  cycles.  If  zero  values  are  provided  for  by  the  user, 
the  SDO  model  default  is  exercised  as  follows; 


Manufacturing  Assembly  Level 

1 

2 

3 

4 

F 

1.0 

0.23 

0.  4.3 

0.05 

The  above  values  are  based  on  Hughes'  manufacturing  experience  at  the  various 
assembly  levels. 

Fraction  defectives  corrected  (R1  for  the  card  level  and  H2  for  the  higher 
assembly  level)  arc  functions  of  the  screen  used,  the  level  of  assembly'  and  the 
number  of  test-rework  cycles.  If  zero  values  are  provided  by  the  user  for  R1  or 
R2  the  SDO  model  default  is  exorcised  (i.  e. , R1  ^ 0.  5 and  R2  = 0.  5). 

The  number  of  assembly  levels  (M)  is  based  on  a card-imit-equipmcnt-system 
assembly  structure,  A value  of  M equal  to  4 will  use  the  complete  .structure 
and  smaller  values  of  M will  use  a limited  structure.  For  example,  a u.ser  may 
only  build  to  the  equipment  level  in  which  case  he  would  set  M = 3. 

The  number  of  defects  entering  the  process  is  bast;d  on  fraction  defectives  for 
parts  (PDEF)  and  assembly  errors  (AI)EF),  the  total  number  of  parts  used  in 
the  system  and  the  numl)er  of  systems  being  produced.  PDFF  is  input  as  a 
fraction  of  the  total  parts  (NPARTS)  and  defaults  to  0.  01  (i.  c. , I'/i  of  the  total 
number  of  parts  used  in  system)  when  user  data  is  not  available.  Similarly, 
ADEF  defaults  to  0.023  (2,37,  of  the  total  parts)  for  all  assembly  levels  when 
user  data  is  not  available.  The  maximum  mimber  of  test-rework  cycles  (NCYC) 
a single  defect  would  see  is  dependent  upon  the  complexity  and  testability  of  the 
hardware.  Since  the  number  of  defects  is  based  on  the  total  parts  required  for 
the  system,  NCYC  sliould  be  sufficiently  large  to  exhaust  the  process  (i.e. , no 
defects  remaining  in  rework),  otherwise  the  systems  being  assembled  are  not 
complete. 

System  Description/Program  Data 


System  de.scription  data  i.s  required  whenever  the  test  sequence  selection  is 
driven  by  a product  reli.'ibility  requirement  (Option  A).  In  this  case  the  model 
requires  the  predicted  failure  I’ate  (h'RM)  for  the  "mature"  system  (e.g. , in 
accordance  with  MIL-lIDBIC-217),  the  required  (by  a eiustomcr  specification) 
system  failure  rate  (FRF)  and  tlie  total  nimibcn-  of  parts  (NPARl'S)  used  in  all 
systems  being  produced.  If  cost  is  the  driving  factor  in  the  tc.st  sequence 
selection  (Option  B),  NPARTS  and  the  total  co.st  budget  (CRKQD)  are  required. 
CREQD  includes  the  budget  for  the  total  tc.st  cost  plus  the  total  rework  cost 
necessary  to  assemble  all  systems. 
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Field  stress  is  characterized  by  three  "tests":  temperature  cycling,  vibration, 
and  power  cycling.  Thus,  defects  that  are  present  in  the  system  at  delivery 
will  continue  to  show'  up  in  the  field  (together  with  random  failures)  until  the 
system  reaches  "Maturity"  (i.e.  , no  more  defects).  At  this  point  in  time,  the 
system  still  fails  but  only  due  to  "random"  failures.  All  latent  defects  have 
been  removed  by  the  field  stress. 

'file  SDO  model  defaults  to  a field  stress  (i.  e. , a "test"  strength)  of  1.  0 and 
three  operating  years  to  maturity  (26,  280  hours).  The  user  can  optionally 
provide  the  estimated  amount  of  field  stress  the  system  will  experience  until 
maturity  is  reached  by  specifying  PMAX^i  for  the  appropriate  tests  and 
CYCMAX.,  . ■' 

The  numljer  of  test  values  (ITV)  represents  the  number  of  values  each  test 
parameter  takes  on  in  computing  screening  strengths  for  each  test.  The  value 
of  ITV  has  a significant  effect  of  the  computer  running  time  and  core  require- 
ments. It  is,  therefore,  recommended  that  the  value  of  ITV  not  exceed  4.  Ihe 
tolerance  (E)  has  a similar  effect  on  computer  running  time  and  core  ’Require- 
ments and  may  be  varied  Wfith  ITV  to  get  better  usage  of  the  model.  U is 
recommended,  however,  that  E does  not  go  below  0.01.  This  value  corres- 
ponds to  eliminating  from  lurther  consideration  those  test  sequences  that  are 
closer  than  1%  in  cost  or  test  strength  at  each  .step  of  the  optimization  process. 

Procedure  and  Examples 

The  example.s  given  in  this  section  detail  the  step-by-.step  procedure  for  using 
the  SDO  mode! . Example  1 dc.scribes  the  procedure  for  determining  the  ortimal 
screen  under  a fixed  cost  constraint  and  Example  2 describes  the  procedure  for 
determining  the  least  cost  screen  for  meeting  a reliability  requirement.  The 
following  general  operational  description  applies  to  all  procedure,?  for  process- 
ing input  data  and  execution  of  the  SDO  model  on  an  IBM  360/370  computer. 

Job  Control  T.anguagc  (JCL)  - The  following  statements  are  required  for 
allocating  storage  and  assignment  of  inpiut  data  files: 


//TF195.56A  JOB  (2,  GENERATED  JOB  STATEMENT 

//  GOG,T09i320,00,42,SNU]VlB),'K218,JAMES,  BE  CLASSES,  REGION=500K , 

//  NOTIFY-TE1955G, 

//  MSGLEVEL--(1, 1) 

/*MAIN  ORG=RM02'J 

//  EXEC  FORTGO,GOPGM=TEMJ>NAME,TIME=10 

SIIR.DSN-TFlOSrjG,  802. MAIN,  LOAD 
DISP-.SMR,  D8N-3'F1955(:.  PROGRM.  DATA 
DLSP  SIIR,  DSN-TF19556.  PD.  DATA 
DISP-8HU,1)SN=TF19556.  F.  DATA 
DISP-SIIU,  DSN  -TFIGG-OG,  It.  DATA 


//STEPLIB  DD  DhSP- 
//GO,FT0'lF001  DD 
//GO,FTHF001  DD 
/7GO,FT08F001  DD 
//GO,FT09F001  DD 
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//GO,  FTlOFOOl  DD  DISP=SIIH,  DSN=TF19556.  AB, DATA 
//GO,  FT12F001  DD  DISP=SHJl,  DSN=TFl 9556.  LIMITS.  DATA 
//GO,  FT13F001  DD  DISP=SI1R,  DSN-TF1955G.  OPS,  DATA 

Definition  of  Input  Data  Sets  - "Plie  above  JCL  creates  the  data  sets  noted  below. 
The  asterisks  denote  that  the  associated  parameter  has  a default  value  and  the 
numbers  in  the  parentheses  give  the  maximum  dimension  for  arrays. 

File  04  PKOGHM  - This  data  set  contains  data  for  the  parameters  NCYC,  M, 
NPAPTS,  CIIEQD,  E,  ITV,  FRF,  FRM,  PDEF*,  ADEF(5)*,  N(5), 

B2,  B3. 

File  08  F-  71\is  data  set  contains  data  for  the  array  F(10,  4,  5)* 

File  09  R ~ This  data  set  contains  data  for  the  arrays  R1  (10,  4,  5)*  and 
R2  (10,  4,  5)* 

File  10  AB  - This  data  set  contains  data  for  the  parameters  Al*,  B1  + 

File  11  PD  - Tills  data  set  contains  data  for  the  array  P (10,  4,  5)* 

File  12  LIMITS  - This  data  set  contains  data  for  upper  and  lower  limits 
on  each  test  parameter 

File  13  OPS  - This  data  set  contains  test  parameter  data  for  simulating 
field  stress 

All  files  must  be  filled.  If  the  default  is  to  he  e.vercised.  yero  \>aliies  hir  ali 
parameters  and  array  elements  must  be  used.  The  input  form  for  each  data 
set  is  "unformatted"  (i,  e. , the  values  for  each  record  are  simply  separated  );y 
commas  - this  is  illustrated  in  the  examples  given  below). 

Diagnostics  - If  the  number  of  combination  of  te.st  sequences  becomes  too  large 
for  a particular  choice  of  number  of  test  parameter  values  (ITV)  and  tolerance 
(E),  a subscript  error  check  will  occur.  The  error  condition  can  be  removed  by: 
(1)  increasing  the  dimension  on  the  appropriate  arrays,  (2)  decreasing  the 
value  of  ITV,  and/or  increasing  the  value  of  E. 

Output  Reports  - All  input  data  used  in  the  EDO  model  is  printed  out  in  table 
form.  If  defaults  are  exercised  the  default  values  arc  printed  in  the  tables. 

The  optimal  test  sequence  is  also  printed  out  in  table  format  and  the  following 
table  gives  a cross-  reference  index  between  test  parameter  number  and  defini- 
tion for  each  test: 


Test  Parameter  Cross  Reference 


Test  Parameter 

No.  1 

No.  2 

No.  3 

No.  4 

Constant  Temperature 
(CT) 

Temp  Extreme 
(TA)  OC 

Test  Time 
(TT)  hours 

- 

Cycled  Temperature 
(CYT) 

Upper  Temp 
(TU) 

Lower  Temp 
(TL) 

1 

Temp  Rise 
(TR) 

per  minute 

Number  cycles 
(CY) 

Vibration  <V'IB) 

Vibration 
G-level  (V) 

Time 

(TM)  hours 

Temp 

(TV)°C 

Number  cycles 
(CY) 

Constant  Power  (CP) 

Time 

(TM)  hours 

— 

— 

— 

Cycles  Power  (CYCP) 

Time 

(TM)  hours 

Number  cycles 
(CY) 

— 

— 

6,2  Fixed  Cost-Optimum  Screen 


A ground  display  equipment  manufacturer  has  a limited  budget  for  funding  a 
test-conditioning  rework  effort  during  production  and,  therefore,  desires  to 
minimize  the  number  of  defects  getting  into  the  final  production  systems  and 
still  remt^.in  within  budget. 


Assembly  Required  Data  for  Coding. 


NCYC  - Number  of  test-rework  cycles  is  set  at  10  as  adequate  to  exliaust 
the  process. 


M - The  number  of  manufaettaring  assembly  levels  is  three:  card 

assembly,  unit  assembly  and  equipment  assembly. 


NPAHTS-  The  display  contains  a total  of  10,000  parts  per  system  and  00 
systems  are  planned  for  production  (i.e.,  NPARTS  = GOOOOO). 


CREQD  - The  total  cost  budget  for  testing  and  rework  is  $500, 000. 

_ Test  screens  that  are  closer  than  1%  in  cost  are  considered  to  be 
equal  (i.e.,  E - O.OI). 


Gl 


ITV 


Three  values  of  a test  parameter  are  felt  to  be  adequately  sensi- 
tive (i.  e. , ITV  = 3). 


FRF,  FRM,  These  parameters  are  set  to  zero  since  the  cost  option  is  being 

PMAXji^and  used  (i.  e. , FRF  = 0,0,  FRM  = 0.0,  PMAX..  = 0.0,  and 

CYCMAXjk  CYCMAXjk  = 0.  0 ) 

AMAX^j^,  AMlNjj^  The  SDO  model  defaults  are  used  for  these  parameters, 

PDEF  The  average  quality  level  of  parts  used  in  the  display  is  1, 5% 

defective  based  on  the  manufacturer's  field  usage  history. 

ADEF  - The  manufacturer's  production  records  show  that  he  can  expect 
0.2%,  0.3%,  and  0.3%  defectives  due  to  assembly  errors,  wiring 
errors  and  generally  poor  workmanship  at  the  card,  unit,  and 
equipment  levels,  respectively. 


P 


F 


R1 


R2 


The  detection  probabilities  of  the  test  equipment  used  by  test 
department  is  assumed  to  be  the  same  as  the  SDO  model  default 
value  (i.  e. , P = 0.  75). 

The  manufacturer  has  found  that  80%  of  unit  and  equipment  failures 
isolate  to  a card  failure.  All  others  are  unit  and  equipment  level 
assembly/wiring  errors. 

Card  level  repair  records  show  that  80%  of  the  defects  arc 
removed  at  each  rework  cycle. 

Assembly  level  repair  records  show  that  50%  of  the  defects  are 
removed  on  each  rework  cycle. 


B2,  B3 


Al,  B1 


The  average  repair  costs  per  defect  are  given  (in  dollars)  as 
follows:* 


Level 

1 

I’ypc  of  Repair  

Card  Test 

Unit  Test 

Equipment  Test 

Card  (B2) 

5. 

60. 

250. 

Assembly  (B3) 

5. 

1 — III  . .1 

25. 

60, 

The  average  test  cost  for  level  arc  given  below  in  dollars  for  Al 
and  dollars  per  hour  tor  B1  as  follows; 


♦The  default  option  could  also  be  used  in  which  case  the  results  would  be  expressed 
in  hours  rather  than  dollars  (see  page  54). 


step  2 


Coding  Inpat  Data.  Based  on  a standard  80-column  IBM  card,  the 
input  for  each  data  set  in  this  example  is  specified  below.  The 
ordfjr  is  the  same  as  in  Step  1 and  each  line  represents  a single 
record. 


File  04  (PROGBM) 

Col.  No.  1 

— r"~” 

10. 3 . 000000.  500000. . 01, 3, 0. , 0, 

.015 

,002 

.003 

.003 

5. , 5. 

f *J  » 

5. ,  5., 

5.,  5. 

5.  ,5. 

60. . 25. 

60. ,25. 

60. ,25. 

60., 25. 

60..  25. 

250..  60. 

250..  60, 

2.50.,  60. 

250.,  60. 

250.  ,60. 


File  11  (PD) 


Col.  No. 

j 


0. 

0. 


1 


fifteen  entries 


0. 


File  08  (F) 


Col.  No.  1 

::  1 


fifteen  entries 


4 


File  09  (R) 
Col.  No.  1 


5 


8..  5 1 

8. . 5 


fifteen  entries 


8,.  5 


File  10  (AB) 


Col.  No.  1 

I 


225. 

, 10. 

225. 

,25. 

225. 

,25. 

100. 

, 10. 

225. 

,25. 

250. 

, 10. 

250. 

,25. 

250. 

,25. 

250, 

, 10. 

225. 

,25. 

250. 

, 10. 

250. 

,25. 

250, 

,25. 

100. 

,10. 

225. 

,25. 

File  12  (LIMITS) 


Col.  No.  1 


0.  ,0. 


13  entries 


0.  ,0, 

File  13  (OPS) 

.Nfl..  i- 
I 

0.  ,0. 

0.  ,0. 

0.  ,0. 
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step  4 


Output  Reports.  The  output  reports  for  this  example  are  given  in 
Tables  6.2  through  6.9.  Table  6. 10  gives  the  optimal  (highest 
test  strength)  screening  sequence  for  the  budget  specified.  There- 
fore, the  best  the  manufacturer  can  do  for  the  given  budget  is  a 
test  strengtli  of  . 7727  which  indicates  that  he  will  eliminate  77. 3% 
of  the  defects  per  equipment  at  a total  cost  of  $494, 240  or  $8,237 
per  system. 


6 . 3 Fixed  Reliability  - Minimum  Cost 


A radar  manufacturer  has  a customer  requirement  for  a 300-hour  system 
MTBF.  Based  on  MIL-HDBK-217  he  estimates  his  radar  system  has  a mature 
MTBF  of  500  hours.  The  manufacturer  would  like  to  determine  the  minimum 
amount  of  screening  (i.e, , least  cost)  which  would  allow  him  to  meet  his 
customer's  requirement.  In  addition  to  choosing  screening  tests,  the  manu- 
facturer also  has  a choice  of  using  higher  quality  parts  in  his  system  which 
would  increase  the  mature  system  MTBF  to  1000  hours  but  would  increase  the 
cost  per  system.  However,  this  action  would  also  reduce  the  number  of  part 
defects  entering  the  manufacturing  process  thereby  reducing  test  rework  costs. 
The  manufacturer's  problem,  therefore,  is  a tradeoff  between  part  quality  and 
amount  of  test  screening  to  determine  (1)  whether  he  should  buy  the  more 
expensive  parts  to  use  in  his  system,  and  (2)  what  screens  should  he  implement 
to  meet  the  required  300-hour  MTBF. 


1.%P  M - 

NCYC  - 
M 


Assemble  Required  Data  for  Coding. 

Number  of  test  rework  cycles  is  set  at  10. 

Four  manufacturing  levels  are  used:  card,  unit,  equipment  and 
system. 


NPARTS  - The  radar  contains  a total  of  20, 000  parts  per  system  and  40 
systems  arc  planned  for  production  (i.e. , NPARTS  = 800000) 


CREQD  - Not  required  for  the  option  (i.e. , CREQD  = 0.0). 


E 


Test  screens  that  are-  closer  than  2%  in  cost  a.re  considered  e^ual 
(i.  e.  , E - . 02) 


ITV 


FRF 

(40 

systems) 

FRM 

(40 

systems) 


Three  values  of  the  test  parameters  are  needed  (i.e.,  ITV  = 3)  to 
provide  the  necessary  sensitivity. 

133320. /lO*^  hours  (300-hour  MTBF  per  system)  customer 
requirement  for  40  systems. 

80000. /lO^  hours  (500  hours  MTBF  for  a mature  system  using 
medium  quality  parts) 

40000. /lO^  houi's  (1000-hour  MTBF  for  a mature  system  using 
high  quality  parts) 
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TABLE  6.6 

TABLE  E - FRACTION  OF  DEFECTS  REMOVED  AT  THE  PRI^L^RY  LEVEL  PER  REWORK/RETEST  CYCLE 
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TOTAL  COST 

TOTAL  SEQUENCE  TEST  STRENGTH  --  0.951277 

0.  772650 


PMAXjk,  - 
CYCMAXjk 


Over  a 3 -year  Held  usage  period  the  radar  is  expected  to 
experience  temperature  cycling  and  power  on-off  cycling 
characterized  by  approximately  1095  cycles  of  power  (on:2.  5 hours 
and  off;2.  5 hours,  i.e.  PMAXgj^  = 5 hours  and  CYCMAX52~1095) 
and  1095  cycles  of  temperature  <at  2°C/min.  between  extremes, 
i.  e. , PMAX23  = 2 and  CYCMAX24  = 1095. 


PDEF  - The  average  part  quality  is  estimated  at  1%  defects  for  existing 
parts  and  0.  5%  for  high  quality  parts. 


ADEF 


R1 

R2 


The  average  percentage  of  assembly  type  defects  from  the  manu- 
facturing process  is  estimated  at  1.2%  of  the  total  number  of  parts 
per  system  (i.e.,  0.3%  at  each  of  four  assembly  levels). 

Card  level  repair  records  show  that  80%  of  the  defects  are 
removed  on  each  rework  cycle. 

Assembly  level  repair  records  show  that  50%  of  the  defects  are 
removed  on  each  rework  cycle. 


P,  F,  - The  manufacturer  decided  to  use  SDO  model  defaults  for  these 
B2,  B3,  parameters  in  this  tradeoff. 

Al,  B1 


AMAX^]^,  - 
AMINjk 


The  temperature  extremes  used  in  the  SDO  model  were  not 
adequate  for  the  radar  system  so  these  were  extended  to  -55°C 
and  125^0.  All  other  default  test  values  were  considered  adequate. 


Step  2 


Coding  Input  Data 


Case  A;  Existing  quality  parts 


File  04  (PROGRM) 

Col.  No.  1 
J 

10,  4,  800000,  0,  ,01,  3,  133320.,  80000. 


. 010 

nn  o 
• wu 

.003 

.003 


.003 


0.,0. 

o.,o.  I 


20  entries 


0. 


0.  J 


70 


1 


File  11  (PD) 


(All  20  values  set  to  zero) 


File  08  (F) 

(All  20  values  set  to  zero) 
File  09  (R) 

Col.  No.  1 

^ 

.8,.  5 ’I 
.8,.  5 


20  entries 


.8,  .5  , 

File  10  (AB) 


(All  20  values  set  to  zero) 
File  12  (LIMITS) 

Col.  No.  1 

j 

125. , -55. 

0.  ,0 

125.  ,25. 

-55., -25 

0.  ,0.  . 

. y 9 entries 

0.  ,0 

✓ 

File  13  (OPS) 

Col.  No.  1 
; ■ 

2. . 1095, 

0.  ,0 

5. , 1095. 


Step  3 


Prepare  Card  Deck  for  Processing 
(Same  as  previous  example) 
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Output  Reixiiis.  'J  lie  output  reports  for  Case  A are  given  in 
Tables  6.  11  through  6,18.  Table  G.  19  gives  the  optimal  screen- 
ing seciuence  which  will  meet  customer  MTBF  requirements  at 
minimum  cost  using  medium  quality  parts.  The  test  strength  of 
the  total  sequence  will  remove  an  estimated  95%  of  the  total 
defects  entering  the  manufacturing  j>voeess.  Cost  la  in  terms  of 
total  labor  hours  for  test  and  rework  effort  for  the  total  program 
(i.  e. , manufacturer  of  40  radar  systems).  The  average  cost  per 
system  is  4364  hours  in  test/rework  labor. 

Case  B:  High  quality  parts 

The  only  change  to  the  input  data  is  in  File  04  (PROGRM)  which  is  shown  below: 
File  01  (PROGRM) 

Col.  No.  1 

10,  4,  800000. , 0, . 02, 3,  133320. , 40000. 

.005 
. 003 
.003 
.003 
.003 
0.,0.  ' 

0.,0. 

• ► 20  entries 

* 

0.  ,0.  . 

The  output  reports  for  Case  B are  given  In  Table  6.20  through  6.27. 

Table  6.28  gives  the  optimal  sequence  for  this  case. 
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Comparing  the  results  of  Case  A and  Case  B shows  that  a total  savings  of 
53, 535  hours  can  be  realized  In  test  and  rework  costs  of  using  the  higher 
quality  parts.  This  amounts  to  a savings  per  system  of  1338  hours.  If  a labor 
rate  of  $20  per  hour  is  used,  $26, 760  per  system  Is  saved.  This  amount  must 
of  course  be  offset  by  the  increased  cost  per  system  using  the  higher  quality 
parts.  If  there  is  still  a significant  savings,  the  decision  would  be  to  use  the 
higher  quality  parts  and  screen  according  to  Table  6.28.  If  there  is  no  savings, 
the  decision  would  be  to  use  the  mediu'"i  quality  parts  and  screen  according  to 
Table  6. 19. 

It  should  be  noted  (also  see  p.  48)  that  the  tests  given  in  the  tables  for  a given 
level  of  assembly  can,  of  course,  be  conducted  at  the  same  time  which  would 
further  reduce  associated  testing  coats. 
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SECTION  7.  0-  RECOMMENDATIONS  AND  CONCLUSIONS 


In  any  development  of  an  SlXj  model  the  key  variables  are  test  costs,  (fixed  and 
variable),  screening  strength  (SS)  and  probability  of  detection  (Pd).  In  this 
present  study  we  were  able  to  obtain  quantitative  Information  on  all  three  of 
these  parameters. 

However,  the  issue  is  far  from  closed  on  the  vai'iables  screening  strength 
and  probability  of  detection.  Good  estimates  of  these  two  parameters  are 
required  for  any  tradeoff  studies  regarding  the  cost-effectiveness  of  screen- 
ing and  debugging  tests.  Unfortunately,  beyond  this  present  study,  little  has 
been  done  regarding  quantitative  functions  for  SS  and  Pd.  Pdi  of  course,  is  an 
"equal"  component  of  test  strength  (TS).  It  is  entirely  conceivable  that  analytic, 
or  at  least  quantitative,  models  for  P^j  can  be  developed.  The  development 
would  proceed  much  along  the  lines  of  a failure  modes  and  effects  analysis. 

Types  of  failures  could  be  identified,  the  type  of  test  equipment  needed  to  detect 
them  ano  so  on.  The  determination  of  SS  might  not  be  as  "easy"  as  Pd  but  it  is 
clearly  worth  further  study.  In  view  of  the  difficulty  in  measuring  SS,  fairly 
carefully  designed  experiments  would  be  required  to  randomize  out  the  super- 
fluous effects  such  as  the  (unknown)  number  of  defects  entering  the  screen. 

Also,  care  should  be  taken  to  control  or  design  out  Pd  for  the  determination 
of  SS. 

It  is  recommended  that,  as  part  of  applying  the  model  results,  the  techniques 
of  monitoring  and  controlling  the  screening/debugging  process  be  further  studied 
and  developed  and  that  a data  base  be  built  for  verification  and  refinement  of  the 
model  inputs. 
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ArrERDix  A 


A.  1 UCLA -Biomedical  Computer  Program  (BMD07R) 

In  the  computation  of  Test  Strength  for  Card/Unit  Level  and  F.quipment/System 
Level,  and  determining  the  Test  Strength  Relationship  to  Nutnbcr  of  Subcon- 
tractors, the  BMD07R  computer  program  was  used  to  find  various  parameter 
values,  BMD07R  is  a nonlinear  least  squares  regression  program  that  incor- 
porates with  the  canned  routine  the  user  supplied  functional  equation,  partial 
derivatives,  parameters  and  variables.  Sample  functions  and  variable  values 
along  with  estimates  for  the  parameters  are  used  in  an  iteration  scheme 
designed  to  converge  to  the  parameter  values.  The  UCLA  BMD07R  program 
is  accessed  by  the  IBM  370  system  through  use  of  the  cataloged  procedure, 
BMDT,  which  provides  the  necessary  job  control  language.  These  programs 
use  the  FORTRAN  IV  language. 

A.  2 General  Curve  Plotting  (QKPLOT): 

A curve  plot  was  given  in  FTgure  4.  1 under  the  Computation  of  Test  Strength  for 
Card/Unit  section.  QKPl.OT,  or  "Quick  Plot"  is  .a  computer  subroutine  avail- 
able in  the  IBM  370  Scientific  Subprogram  Library.  A user  can  implement  it 
by  making  a call  to  QKPLOT  while  providing  the  necessary  points  to  be  plotted, 

A logarithmic  X (time)  and  linear  Y = F(X)  (test  strength)  set  of  axes  was  chosen 
and  more  than  a tliousand  points  were  plotted.  This  program  can  be  accessed 
using  FORTRAN  IV  language. 

A.  3 Multiple  Linear  Regression  (MI.HG):  Least  Squares  Fit  and  Analysis 

Regression  analyses  were  performed  in  the  sections  on  Computation  of  Test 
Strength  for  Kquipment/System  l.evel  and  Conversion  of  MTBF  to  Defects,  in 
which  the  computer  program,  MLRG,  was  used,  MLRG,  is  a subroutine  avail- 
able in  the  IBM  370  Scientific  Subprogram  Library.  A call  to  this  routine  with 
a set  of  observations  of  dependent  and  independent  variables  will  cause  it  to 
compute  the  coefficients  of  a multiple  linear  equation  expressing  the  dependent 
variable  as  a function  of  the  independent  ones.  MLRG  also  calculates  a set  of 
statistical  quantities  such  as  the  coefficient  of  multiple  determination  which 
provides  a measure  of  the  least-squares  fit.  This  program  can  be  accessed 
using  the  FORTRAN  IV  language. 

A.  4 Least  Squares  Curve  I’it  (CUHl'JT) 

In  the  sections  on  Conversion  of  MTBF  to  Defects  and  Determining  Relationship 
of  Test  Strength  to  Number  of  Subcontractors  and  Percent  Non-Standard  Parts, 
the  computer  program,  CURFFl'  was  used  for  the  regression  analysis.  This 
program  is  available  on  the  Dartmouth  Tinic  Sharing  System  (DTSS)  and  is 
written  in  the  BASIC  language.  Using  the  input  data  values  for  the  independent 
and  dependent  variables,  the  routine  fits  them  to  six  different  curve  types,  with 
output  information  of  the  measure  of  fit  and  the  equation  coefficients.  The  six 
curves  used  are: 

(1)  Y = A + BX,  linear 

(2)  Y = Ae^^^,  exponential 


S4 


(8) 

6' 

= power 

(4) 

Y' 

= A > B/X,  hyperbolic 

(5) 

Y 

= 1/(A  ^ BX),  hyperbolic 

(0) 

Y 

= X/(A  < BX),  hyperbolic 

A.  5 SI)0  Compuler  Program  Printout 


INTEGER  T 

IKTEGER*2  TV(20,300) ,SBQ(20,300) ,TVl(17000) ,SBQl (17000) 
DIMENSION  N(5) ,AnEF(5)  ,F(li,4,5) ,Rl(ll,4,5) ,R2(11,4,5) ,CT(5,5) , 
+CRl(5,5) ,CR2(5,5) ,TS(20,300) ,TC(20,300) ,Nl(20) ,NF(20) , 
+P(11.4,5) ,TS1(17G00) ,TC1(17000) ,Sa)ST(5,5) ,IAfiRAY(20) , 
+PARRAy(ll,4,5) 

DATA  NF, TS, 1C, TSl,TCl/20*0, 46000*0,/ 

DATA  PARRA Y/2 20 *1.0/ 

DATA  P,F,Rl,R2/8tiU*l,0/ 

DATA  N/5*5/ 

CALL  DATA  (NCYC,M,PDEF,CREQD,E,ITV,N,ADEF, 

-t  P , F , Rl , R2  ,CRl , CR2 , FRF , FRM , LEVEL, I TYP, 

+AMAXll,AMI.Mll,AMA)(12,AMINl2,AMAX2i,AMIN2l,AMAX22,AMIN22,AWAX23, 
+AMIN23,AMAX24,AMIN24,AMAX31,AM1N31,AMAX32,AMIN32,AMAX33,AMIN33, 
+AMAX34 ,AMIN34 ,AMAX41 ,AMIN41,AMAX51 ,AMIN51, AMAX32 ,AMIN52) 

LL“0 

ADIN=0,0 
DO  1 1=1, M 
1 ADIN=ADIN+AOEF(I) 

DIN=AOIN+PDeF 
IF(FRF.EQ.O.O)  GO  TO  5 

oprs=o.o 

oprs2=o.o 

HaJRS2=U.O 

DO  220  1=1,3 

GO  TO  (201,202,203) ,I 

201  12=2 

r*o  •Tn'\  T ‘ A 

A-'*/  ^ -*.V/ 

202  12=3 

GO  TO  210 

203  12=5 
210  COMITNUE 

HEAO(13,*,END=22U)  PMAX,CYCMAX 

IF  (PMA.<.EQ.0.0.OR.CYCMAX.EQ.0.0)  GO  TO  220 

CALL  ,SSPI3OB(TTV,ITV,ITV,ITV,M,I2,PARitAY,l,Cr,0.  ,0.  ,1'rV, 

+HOURS  ,AM/\Xil,AMlNll , AMAXl2,AMINl2,AMAX21,AMIN2i  ,AMAX22  ,AMIN22, 
+IW0< , AMI N2  3 , CYCMAX , AMI  N2 4 , AMAX 31 , AMI N3 1 , Pt-IAX  , AMI N3  2 , AMAX3 3 , 
+AMIN33,CYCMAX,AMIN34,AmX4l,AMIN41,PMAX,AmN5i,CYCMAX,.AI4l  152) 
OPrSl=PARPAY  ( 1 , M , 1 2) 

0Pi'STOprs2+0Prsi*  (i . o-oi>i'S2) 
oprs2=oprsi 

IIOUiiSl=HOURS 

llOURS'I-AMAXl  (HOURSl  ,llOUHS2) 


00000010 

00000020 

00000030 

00000040 

00000050 

00000060 

00000070 

00000080 

00000090 

00000100 

00000110 

00000120 

00000130 

00000140 

00000150 

00000160 

00000170 

00000180 

00000190 

00000200 

00000210 

00000220 

00000230 

00000240 

00000250 

000002GO 

00000270 

nnnnn Apn 

yjyjyf  wty  ^ / 

00000290 

00000300 

00000310 

00000320 

00000330 

00000340 

00000350 

00000360 

00000370 

00000380 

00000390 

00000400 

00000410 

00000420 

00000430 
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r 


H0U^‘S2=H0Ul?ST 

oooooo  a 

PARRAY(l,M,I/)=i.O 

000004bu  m 

220  CONTINUE 

00000460  m 

GO  10  240 

00000470  S 

230  OPTS=1.0 

00000480  i 

HOURST=26200. 

00000490  ^ 

240  IF  (OPrS.EQ.0.0)  GO  TO  230 

00000500  ! 

DF£QD=HOUfc?r* ( (10.**(-6) )*(FRF-FKM) )/OPTS 

00000510  ^ 

SREQO*l . 0-DREQD/DIN 

00000520 

WRITE(6,*)  HOURST,SReQD 

00000530  - ■ 

5 EX)  50  11=1,  K 

00000540 

Nll=N(Il) 

00000550 

DO  52  I2=l,NIl 

00000560 

LL=LL+1 

00000570 

MV=0 

00000580 

READ(10,*,END=7)  A1,B1 

00000590 

GO  TO  8 

00000600 

7 Al=0.0 

00000610  1 

Bl=0.0 

00000620 

8 DO  103  KK4=1,ITV 

00000630 

DO  103  KK3=l,nV 

00000640 

EX)  102  KK2=i,rrv 

00000650  i 

DO  101  KK1=1,HV 

00000660 

MV=MV+1 

00000670  : 

DO  10  K,NCYC 

00000680  ; 

10  PAREy^Y(I,Il,l2)=P(I,Il,I2) 

00000690  1 

CALL  SSPROB  (KKl  ,KK2 , i;K3  , KK4  ,Il  ,12 ,PARPJ'.Y,NCYC  ,CT,A1,B1,T.1V,HC-JPS; 

00000700  1 

+AHAX 1 1 , AMI Ni 1 , AMAXl 2 , AMINl 2 , AMAX 21 , AMIN21 , AMAX2 2 , AMI N22 , AMAX 23 , 

00000710-  1 

+AMIN2 3 , AMAX24 , AMI M24 , AMAX31 , AMIN31 , AMAX32 ,AMI N3 2 , AMAX33 , AMI N3 3 , 

00000720  I 

+AMAX34 ,AMIN34 ,AMAX41 ,AMIN41 ,AMAX51 ,AMIN51,AMAX52 ,AMIM52) 

00000730 

CALL  SCREEN (NCYC,M,N,PE«t\DIN,ADEF,PAEyy^Y,F,Rl,R2,CT,CRl,CR2,SS, 

00000740 

+TO3ST,Il,l2,S00ST,TCMIN,0.0) 

00000750 

l' 

TS(LL,MV)=SS 

00000760  i 

TC(I,L,MV)=1'OOST 

00000770  ' 

j 

101  CONTINUE 

00000780  j 

i 

\ 

IF(l2-4)  102,104,102 

00000790  ( 

102  oonriNUE 

00000800 

IF( (12-1)* (12-5) ) 103,104,103 

00000810  ■ 

i 

103  CONTINUE 

00000820 

f 

104  corrriNUE 

00000830  i 

EX)  12  1=1,NCYC 

00000840  ) 

12  PARRAY(I,I1,I2)=1.0 

00000850  i 

1 

\' 

IJKLL)  =MV 

OUOOOB60  ’ 

IF(LL-2)  52,15,20 

00000870  1 

X 

15  ia=Nl(LIy-l) 

00000880  1 

t 

GO  ID  30 

00000890 

20  K1=K 

00000900  ? 

30  K2=Ni(LE.) 

00000910 

t 

N3EQ=K1*K2 

00000920  : 

DO  40  Jl=l,Kl 

00000930  ; 

DO  40  J2=1,K2 

00000940  ^ 

i 

> 

• 

; 

U=TS(LL,J2)*(1.0-^rS(L[i-l,01))4T’S(LL-l  ,J1) 

80 

0000(^950  ; 

V=TC  (LI/-1  ,J1)  + ( 1 .“TS  (LL-1  ,J1) ) *TS(LL,J2)  *TC  (LL,J2) 
36  NF (LL) =NF (LL) +1 
JJ=NF(LL) 

SEQl (JJ)=Jl 
TVi(JJ)<I2 
TSl (JJ)=U 
l‘Cl(JJ)=V 
40  COMTINUE 

CALL  FANK(TSl,TCl,NSEQ,St)Ql,TVl) 

OC=0.0 

QS=0.0 

K=0 


DO  51  I=1,NSEQ 

IF( (TSl(I) .EQ.0.0) .OR. (TCi{I) .EQ.O.O) ) GO  TO  51 
IF{  (TSl(I)-OS)  ASld)  .LT.E)  GO  TO  51 
IF( (TC1(I^-QC)/TC1(I) .LT.E)  GO  TO  51 

Qc-rcid) 

QS=TSl(I) 

K=K+1 


TC(LL,K)=TC1(I) 

TS(LL,K)=TSld) 

SEQ(I,L,K)=SEOld) 

TV(LL,K)=TV1(1) 

TCld)=(J. 

TSl(I)=0. 

SEQl (I) =0 
TVld)=U 

51  CONTINUE 

52  CONTINUE 
50  CONTINUE 

CALL  Si:ARCh(LL,K,CREQD,SIREQD,S12Q,TV,T'C,TS,TARRa.^,TCNIN,TSMAX,DIN) 
CALL  REPORT  (M,NCrc,N,PDEF, DIN, ADEF,P,P,Rl,R2,Cr,CRl,CR2,IARRA!ir, 
+Al , Bl , ITv  ,TCMI  N , TSMAX , 

+Af'AXll ,AMINll ,AMAX12 ,AM1N12,AMAX21,AMIN21 ,AMAX22 , AMIN22 ,AMAX23 , 
+Am N2 3 , AMAX 24 , AMI N2 4 , AMAX3 1 , AMI N3 1 , W1AX 32 , AMI N3 2 , AMAX 3 J , AMI N3 3 , 
+AMAX34  ,AMIN34  ,AMAX41  ,AMIN41  ,AMAX51  ,AMIN51,  AMAX52 , AJ'1IN52) 

DEBUG  SUBCHK 


END 


FT'  i~i  • T>'/  /""nT  /^r>T 

' / i'  f r\x  f rvw  # f 


+SS , TGOST , 1 1 , 1 2 , SCOST , TO  J N , FLAG) 

DIMENSION  X(ll,4,5) ,P(11,4,5) ,F(11,4,5) ,Kl(li,4,5) ,Q(20) , 
+R2(11,4,5) , 

+TOOSTL(5,5) ,CUSTL(5) ,N(5] ,CT(5,5) ,CKl(5,5) ,ADEF(5) , 
■K:k2(5,5)  ,Sa\ST(5,5) 

DO  10  1==1,NCYC 


DO  10  J=1 ,M 


NJ=N(J) 

DO  10  K=1,NJ 
10  Xd,J,K)=0.0 

X(1,1,1)=ADEF(1)+PDEF 
DO  35  J=1,M 


KJ^NIvJ) 


00000960 

00000970 

00000960 

00000990 

OOOOlOOO 

00001010 

00001020 

00001030 

00001040 

00001050 

00001060 

00001070 

00001080 

00001090 

00001100 

00001110 

00001120 

00001130 

00001140 

00001150 

00001160 

OOOOU7Q 

00001180 

00001190 

00001200 

00001210 

00001220 

00001230 

00001240 

00001250 

00001260 

00001270 

00001280 

00001290 

00001300 

00001310 

00001320 

00001330 

finrim  /in 

Ky\j\j\j 

00001350 

00001360 

00001370 

00C013C0 

00001390 

00001400 

00001410 

00001420 

00001430 

00001440 

000U145U 

00001460 

00001470 
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DO  35  K=1,NJ 
IF(K-l)  20,20,32 
20  IF(J-l)  35,35,31 

31  X ( 1 , J , K ) =P ( i , J~1 ,N  ) *X ( 1 , J-i ,N ( J-i) ) +ADfc;F ( J ) 

GO  TO  35 

32  X(1,J,K)-P(1,J,K-1)*X(1,J,K-1) 

35  CONTINUE 

SUMX=0. 

DO  95  I=l,NCyC 
X(I+1,1,1)=0.0 

50  DO  51  J=1,M 
NJ»N(J) 

DO  51  K=1,N7 

51  X(H-l,l,l)=X(I+l,l,l)  + (l-P(I,J,K))*F(I,J,K)*(l-Rl(i,J 
DO  94  J=1,M 

NJ*N(J) 

DO  94  K=1,NJ 

IF{X(I,J,K)  .LT.1.0)  C30  TO  94 
IF(J.EQ.l.AND.K.EQ.l)  GO  TO  94 
IF(J.GT.l.AND.K.BQ.l)  GO  TO  90 
IF(J.GE.l.AND,K.GT.l)  GO  TO  80 
GO  TO  94 

90  X (I+l , J , 1) =P (I+l , J-1 ,N (J-1 ) ) (I+l , J-1 ,N ( J-lj ) + 

+ (1-P(I,J,1)  >*{1-F(1,J,1)  )*a-P2(l,J,l))*X{I,J,l) 

GO  TO  94 

80  X(I+]  ,J,K)=P{I+1,J,K-1)*X(H-1,J,K-1)  + (1-P(I,J,K)  )*(1- 
*{1-R2(I,J,K))*X(1,J,K) 

94  CONTINUE 

SUM=0.0 

DO  110  1^1,  Nac 
NM=N (M) 

SUM*SUf4fX(I,M,NM)  *P(I,M,NM) 

110  CONTINUE 
DOUT=SUM 
SS=1.0-DOUT/DIN 
DELTA=DIN-DOUT 
AOOST=0.0 
TO0ST=0.0 
DO  120  J=1,M 
DO  120  K=l,5 
120  soDST{j,f';;"'0-o 

IF(F[,AG.NF_.  0.0)  GO  TO  12o 
DO  200  ■j,=l,NCYC 

CR=CRlui,I2)*Fa,ll,I2)+CR2(Il,l2)*(i.0-F(I,Il,I2)) 

COST<T(I1,I21+CR*(1.0-P(I,I1,I2))*X(I,I1,I2) 

2Gt,  AOOST=AOOST+COST 
GO  TO  205 
I'le  DO  160  J-1,H 
DO  160  K=l,5 
SU?4TSl=0  0 
SUr41“S2=0.0 
DO  130  1=] ,NCYC 


00001480 
00001490 
00001500 
00001510 
00001520 
00001530 
00001540 
00001550 
00001560 
00001570 
00001580 
00001590 
00001600 
,K))*X{I,J,K) 00001610 
00001620 
00001630 
00001640 
00001650 
00001660 
00001670 
00001680 
00001690 
00001700 
00001710 
00001720 
P(I,J,K))*  00001730 

00001740 
00001750 
nnnm  7f;n 


00001770 

00001780 

000U1790 

00001800 

00001810 

00001820 

00001830 

00001840 

00001850 

00001860 

00001870 

00001880 

00001890 

00001900 

00001910 

0UUUIb»2U 

00001930 

00001940 

00001950 

00001960 

00001970 

C0001980 

00001990 

00002000 


suMrsi^suMrsl+ (i.-p (i , j ,k) ) *x (i , j,k) 

00002010 

i3U  SUWrS2=SUWS2>X(I,J,K) 

00002020 

SOOST ( J , K ) *SUMrSl/SUMTS2 

00002030 

160  TODST»TC):)ST+SOOST’(J,K) 

00002040 

siMrc»o.o 

00002050 

DO  140  J*1,M 

00002060 

DO  140  K^l,5 

00002070 

Sa)ST (J,K)  =S(X»ST( J ,K)  * (TC^ffN/TOOST) 

00002080 

140  suwrosuNrrc+soosT(j,K) 

00002090 

TOOST=suK:rc 

00002100 

GO  TO  300 

00002110 

205  IF(DIN^DOOT)  210,210,220 

00002120 

210  DELrA=1.0 

00002130 

220  TOOST=AOOSTA>ELTA 

00002140 

300  FiTPURN 

00002150 

DEBUG  SUBQiK 

00002160 

END 

00002170 

SUBROUTINE  EUV«{(TSl,TCl,NSEQ,SEC'i,TVl) 

00002180 

IWrEX;ER*2  TVl  (17000)  ,SBQ1(  17000) 

00002190 

DIMENSION  TSl ( 17000) , TCI (17000) 

00002200 

N2-NSB0 

00002210 

M1-N2 

00002220 

650  Hl=INT(Ml/2.) 

00002230 

IF(Ml.EQ.O)  GO  TO  830 

00002240 

Hl=N2-Ml 

00002250 

J=1 

00002260 

690  I*J 

00002270 

700  L1=I+M1 

C00022Q0 

IF(TCi(I) .LE.TCi(Ll))  GO  TO  800 

00002290 

Ai*rci(i) 

00002300 

B,1=TS1{I) 

00002310 

A2=SEQ1(I) 

00002320 

B2=TV1(I) 

00002330 

TCi(I)=TCi(Ll) 

00002340 

'lSi(I)=TSl(Ll) 

00002350 

SEQ1(I)=SEQ1(L1) 

00002360 

T'/l(I)=TVl{Ll) 

00002370 

TCl(Li;=Al 

00002380 

TSi(Ll)=Bl 

00002390 

SEQ1(L1)=A2 

00002400 

'IVl(Ll)=B2 

00002410 

I*I~Mi 

00002420 

IF{I.GE.l)  GO  TO  700 

00002430 

800  J<J+1 

00002440 

IF(J.LE.Hl)  GO  TO  690 

00002450 

GO  TO  650 

00C02460 

DEBUG  SUBCHK 

00002470 

830  RETURN 

00002480 

END 

00002490 

SUBROUTINE  SEARCH (LL,N0 ,CR02D,SREQD,SBO,TV,TC,TS,IARBAy,TCMIN, 

00002500 

+TSMAX,DIN) 

00002510 

INTEGER  T,S,S1,S2 

00002520 

IWrEGER*2  TV(20,3U0) ,SEQ(20,300) 

00002530 
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DIMENSION  TC(20,300)  ,TS(20,300) ,IARRAY(20) 

DO  1 

Tcrar»Tc (LL,i ) (ll,i ) 

1 TC(LL,I)=TCIOT 
IF(CRBQD)  5,510 
5 IF(SREQD)  400,400,15 
10  K»H0 

7 IF(TC(rX,K)"CREQD)  20,20,25 
15  K=1 

17  IF(TS(LL,K)-SREX)D)  30,20,20 
20  Sl*SEQ(LL,K) 

T=TV{LL,K) 

(LL) --T 

TCMIN--TC(LL,K) 

TSr'1AX=TS(LL,K) 

K-1 

GO  TO  40 
25  K»=K-1 

IF(K)  200,200,7 
30  K*K+1 

IF(K-NO)  17,17,200 
40  I*LL-1 

45  IF(I-l)  300,300,100 
100  S=SEQ(I,S1) 

T=TV(I,Slj 

S2=S1 

Sl=S 

lARWY  (T ) =T 
i=I-l 
GO  TO  45 

200  WRITE(6,201) 

201  FORMAT  (/lx, 'RBQUIREMENl'  CANNOi’  BE  MET') 

STOP 

300  IARRAY(1)=S 
400  CONTINUE 

DEBUG  SUBOiK 
RETU1«4 
END 

SUBROUTINE  SSPROB (Kl,K2,K3,K4,Il, 12, P,NC:YC,Cr,Al,Bl^HV, HOURS, 
+AMAX 1 1 , AMI  Nl  1 , AMAX 1 2 , AMI  N 1 2 , AMAX  2 1 , Ani  N 2 1 , AMAa  2 2 , AMi  N 2 2 , AmX  2 3 , 
+AMIN23,AMAX24,AMIN24,AMAX3:!  ,AMIN31,AMAX32,AMJN32,AMAX33,AMIN33, 
+AMAX34  ,AMI  N34 , AMAX41 , A.4I  N41 , AMAX51  ,AMIN51,  AMAX52 , AMIN52) 
DIMENSION  P(ll,4,5) ,CT(5,5) 

GOTO  (10,20,30,40,50) ,12 
10  CONTINUE 

C TEST  ONE:  CONSTANT  TEMPERATURE  (CD 

El=EXP(  .0122*  (( (AMAXll-AMI Nil)  *Kl+AMINil*ITV-AMAXll)/(ITV-l. ) + 
+273.0) ) 

E2=EXP(-{ (AMAX12-AMIN12) *K2+AMINl2*ITV-AMAXl2) *. OOOC263*El/ 

+ {I'IV-1.)) 

PFT=.6*(1.0-E2) 

ss=l.0“PFr 

HOUKS=-  ( (Ar'lAXl2“AMINl2)  *K2+AMIN12*T'IV-AMAX12)/(ITV~1.  ) 
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IF(Bl)  11,11,105 
11  GO  10(101,102,103,104) ,11 

101  CT{1,I2)« (0.15) •HOURS 
OD  TO  60 

102  CT(2,I2)«(0.15)*HOURS 
00  TO  60 

103  CT(3,I2)»H0URS 
CO  TO  60 

104  CT(4, 12) -HOURS 
GO  TO  60 

20  OONTINUE 

C TEST  TOO;  CYCLED  TEMPERATURE (CYT) 

TE-  ( (ABS  ( ( {AMAX21-AMIN21)  *Kl+AMIN21*ITV-AMAX2l)/(nV'l . )-25.  ) + 
+ABS(  ( {AMAX22-AMIN22)  •K2+AMIN22mV'AmX22)/(nV>l.)“25.0) ) + 
+50.0)/2.0 

El-EXP ( . 0122* (TE+273 . 0) ) 

TT-  ( (AMAX23- AMIN23)  •K3+AMIN23*HV-AMAX23)  M.5/(ITV-1, ) 

E2»EXP(-(  (AMAX24-AMIN24)*K4+AMIN24*ITV-AMAX24)*TT*.0000263*El/ 
+(ITV“1.)) 

PFDT=.8*(1.0-E2) 

IF  ( (AMA:<21-AMIN21)  •K1+AMIN21*HV-AMAX21.BQ.  (AMAX22 
+-AMIN22)*K2+AmN22*IlV-AWvX22)  PFOT-0. 

SS=1.0-PFDT 

IF(  (AMAX23-AMIN23)  *K3+AMIN23*I'IV-AMAX23)  5,5,7 
7 HOURS=(  (AMAX21-AMIN21)  *K1+AMIN21*I1V-AMAX21+(AMAX22-AMIN22)  *K2+ 
+AMIN22*HV-A_MAX22)  * ( (AJ4ftX24-AJ4IN24)  *K4+A_MIf324*I1V-AMAX24)  / 

+ (60.*  ( (AMAX23-AMIN23)'*K3+AMIN23*ITV-AMAX23)  *(ITV-1.) ) 

GO  TO  8 
5 HOURS=0. 
a IF(B1)21,21,105 

21  GO  10(201,202,203,204) ,11 

201  CT(1,12)=(0.15)*HOURS 
(30  TO  60 

202  CT(2,I2)=(0.15)*HOUBS 
GO  TO  60 

203  CT(3,I2)=H0LBS 
GO  TO  60 

204  CT (4, 12)  =HaiRS 
GO  TO  60 

30  CONTINUE 

C TEST  THREE:  VIBRATION (VIB) 

TE-ABS ( ( (AMAX33-AMIN33) *K3+AMIN33*I1V-AMAX33)/ (ITV-l. ) ) +25.0 
El=EXP(.0122*(TE+273.0) ) 

E2=EXP(--(  .0000789*  ( (AMAX3i*-AMIN31)  *K1+AMIN31*HV-AMAX31)  * { (AMAX32- 
+AMIN32)  *K2+AMIN32*ITV-AMAX32)  * ( (AmX34-AMIN34)  *K4+AMIN34*ITV~ 
+AMAX34)  *E1)/(HV-1.)  **3) 

PFV=.2*(1.0-E2) 

SS=1.0-PFV 

HOURS-  ( (AMAX32  'AMIN32)  *K2+AMIN32*I1V-AMAX32)  * ( (AMAX34-AMIN34)  *K4+ 
+AMIN34*ITV-AMAX34) /(60 . * (ITV-l . ) **2) 

IF(Bl)  31,31,105 

31  GO  10(301,302,303,304) ,11 
301  C'f{l,l2)  = (0.15)*HOURS 
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GO  TO  60 

302  CT(2,I2)=(0.15)*HOURS 
GO  ID  60 

303  CT(3,I2)-=HOURS 
GO  TO  60 

304  CT(4, 12) “HOURS 
GC  TO  60 

40  cowtinuf; 

C TEST  POUR:  CONSTANT  POWER (CP) 

H0URS=  ( (AMAX41-AMIN41)  *Kl+AiMIN41*ITV-AMAX4l)  /(IT/-! . ) 

IF(I1.GT.2)  GO  TO  41 
C CARD/MOIXILE  LEVELS 

PWR“664.965/(  ( ( AmX4 1-AMI N41)  *Kl+AMIN4l*ITV-AMAX41) /(ITV-l.)  + 
+664.965} 

SS=PWR 

IF(Bl)  42,42,105 

42  GO  TO(401,4Q2) ,Il 

401  CT(1,I2)=(0.15)*HOORS 
GO  TO  60 

402  CT(2,I2)=(0.15)*HOURS 
GO  TO  60 

41  CONTINUE 

C EQJIPMENT/SYSTEM  LE^/ELS 

PWR=3049 . 875/  ( { (AMAX41-AM1N41)  *Kl+AMIN41*I'IV-AMAX4l)  /(ITV-1 . ) + 
+3049.875) 

SS*PWR 

IF{B1)  43,43,105 

43  GO  TO(403, 404,403, 404) ,Ii 

403  CT(3, 12) “HOURS 
GO  TO  60 

404  CT(4,I2)=H0URS 
GO  TO  60 

50  CONTINUE 

C TEST  FIVE:  CYCLED  POWER (CYP) 

HO'JRS=  ( (A:4AX51-AMIN51)  *Ki+AMIN51*ITV-AMAX51)  * ( (AMAX52-AM1N52)  *K2+ 
+Af'iI N52*IT2-AMAX52 ) / ( riV‘ 1 . ) **2 
1F(I1.GT.2)  GO  TO  51 
C CARD/MODULE  LEVELS 

_ 9^5  / ! I LA.MAX51— AMIN51)  *Kl+AMIN51*I'r-/— AWAX51)  ^ (ITV— 1 . ) + 
+664.965) 

PWRC=Rl**(  ( (AMAX52-AMIN52)*K2+Af"N52*ITV-AMAX52)/fI'IV-l.) ) 

SS=PWRC 

IF(Bl)  52,52,105 
52  GO  TO (501, 502) ,ll 

501  CT(1,I2)=(0.15)*HOURS 
GO  TO  60 

502  CT(2,I2)=(0.15) *HOUKS 
CO  TO  60 

51  CONTINUE 

C EQUIPMENT/SYSTEM  LEVELS 

Rl=3049 . 875/  { ( ( AMAX51-AMIN51)  *Ki. *-AMIN51*ITV-AMAX5l)  / (ITV-l . ) + 
+3049.875) 

PWRC=Rl**  ( ( (AMAX52-AMIN52)  *'K2+AM1N52*ITV-AMAX52) / (ITV-1. ) ) 
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SS=PWRC 

IF{Bl)  53,53,105 
53  GO  T0(503,504,503,504)  ,Il 

503  CT(3,I2)«H0'JRS 
GO  TO  60 

504  CT{4,l2)*HaURS 
GO  TO  60 

105  CT(I1,I2)«B1*H0URS+Al 

60  continue 

DO  70  I»1,NCYC 
C^^l.O-d.O-SS)  *P(I,I1,I2) 

70  P(I,II,I2)«-D 
D^BUG  SUBCHK 
RETURN 
END 

SUBIOUTINE  REPCKr(M,NCYC,N,PDeF,DIN,ADEF,P,F,Ri,R2,Cr,CRl,CR2, 
ARRAY , A1 , Bl , ITV  ,TCMI  N ,TSMAX , 

+AMAXll,AM*Nll,AMAXl2,AMINl2,AMAX2l,A«IN2l,AMAX22,AWS22,AMAX23, 
+AMIN23 ,AMAX24 ,AMIN24 ,AMAX31 ,AMIN3] ,AMAX32 ,AMIN32,AMAX33 ,AHIN33 , 
+AMAX34 , AMI N34 ,AMAX41 , AMIN41, AMAX51 , AMI N51, AMAX52 , AM1N52) 

REAL  LQOST(5) 

DIMENSION  NP(5,5,5) ,N{5) ,P(11,4,5) ,P(11,4,5) , 

+R1(11,4,5) ,R2(11,4,5)  ,CRl(5,5) ,CR2(5,5) ,Cr(5,5) ,SOOST(5,5) , 
+TEST(5) ,IR(5) ,IARRAY(20) ,ANP(5,5,5) ,ADEF(5) 

REWIND  10 
DATA  NP/125*!/ 

DATA  LOOST/5*0,/ 

DATA  TEST/' CT  ' 'CYT  ' 'VIB  *,'0?  ','CYP  ’/ 

DATA  ANP/i25*0./ 

1=0 

DO  65  11=1, M 
DO  65  12=1,5 
READdO,*)  Al,Bl 
I-I+l 

IR(1)=IARRAY(I) 

GO  TO  (30,50,50,20,30) ,12 
20  NP(I1,I2,1)=IARRAY(I) 

GO  TO  60 

30  DO  33  K=2,3 

1H(K)=MUU(1R(K-1) ,ITV*»(3-K)) 

IF(IR{K-1))  32,32,31 

31  NP(Il,I2,4-K)*Lyr(FLOAT(IR(K-l))/(FLOAT(ITV) )**(3-K)+. 999999) 
GO  TO  33 

32  Nc>(Il,:2,4-K)»ITV 

33  CONTINUE 
GO  TO  60 

40  DO  43  K=2,4 

IR(K)=M0D(1R{K-1) ,riV**(4-K)) 

IF(IR{K-1))  42,42,41 

41  NP(I1,I2,5-K)=INT(FL0AT(IR(K-1) )/ (FLOAT (ITV)  )** (4-'K) +.999999) 
GO  TO  43 

42  NP(I1,I2,5->K)=ITV 

43  CONTINUE 
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GO  TO  60  00004660 

50  DO  53  K»^2,5  00004670 

1R(K)=M0D(IR(K-1)  ,I'IV**(5-K) ) 00004680 

IF(IR(K-1))  52,52,51  00004690 

51  NP(Il,I2,6-K)»ir«'(FLOAT(IR(K-l) )/(PLOAT(ITV) )** (5-K) +.999999)  00004700 

GO  TO  53  00004710 

52  NP(Il,I2,6-K)=nV  00004720 

53  CONTINUE  00004730 

GO  TO  60  00004740 

60  CALL  SSPFOB{NP(Il,I2,l) ,NP(Il,I2,2) ,NP(Il,l2,3) ,NP(Il,I2,4) ,11,12,00004750 
+P,NarC,CT,Al,Bl,ITV,HOURS,  00004760 

+AMAXil,AMINll,AMAXl2,AMINl2,AMAX2i,AMIN2l,AMAX22,AMIN22,AMAX23,  00004770 
+AMIN23,AMAX24,AMIN24,AMAX31,AMIN3l,AMAX32,AMIN32,AMAX33,AMIN33,  00004780 


+AMAX34 , AMI N34 , AMAX41 ,AMIN41 ,AMAX51 , AM1N51 , AMAX52 ,AMIN52) 

65  CONTINUE 

CALL  SCREEN (NCYC , M ,N , PDEF , DIN , ADEF , P , F, Rl , R2 , CT ,CRl ,CR2 , 

+SS , FCOST , 1 1 , 1 2 ,SCOST  ,TCMIN, 1 . 0) 

DO  70  11=1, M 
DO  70  12=1,5 

70  LQOST(I1)=LOOST(I1)+SODST(I1,I2) 

10=0 

WRITE(6,100) 

DO  90  11*1, M 
DO  90  12=1,5 

ANP ( II ,4 ,1) = ( (AMAX4l-AMIN4i) +NP (II ,4 ,1) +AMIN4l*rfV-AMAX4l) / 
+ (1^-1.) 

ANP ( II , 1 , 1) = ( (AMAXll-AMI Nil) *NP (II ,1 , 1) +AMINll*riV-AMAXll) / 
+(ITV-1.) 

ANP{ll,i,2)  = ( (AmXi2-AMlNl2)  *n>'(iI,1,2)+ApUN12*ITv-AH70v12)/ 
+(ITV-l.) 

ANP ( I I , 5 , 1 ) = ( (AMAX 5 1-AMl N5 I ) *NP ( I 1 , 5 , 1 ) +AHI N5 1 * I TV-AMAX 51 ) / 
+ (I'IV"1.) 

ANP ( II , 5 , 2 ) = ( (AMAX 52-AMI N5 2 ) *NP ( 11 , 5 , 2 ) +AMI N5 2*ITV-AMAX52 ) / 
+(ITV-1.) 

ANP (11 ,2,1) = ( (AMAX21-AMIN2i) *NP(I1,2,1)+AMIN21*ITV-AMAX21) / 
+ (nv-i.) 

ANP(I1,2,2)  = ( (AMAX22-A4IN22)*NP(H,2,2)+AMIN22*nV-AMAX22)/ 

+ (nv-i.) 

ANP  ( 1 1 , 2 , 3 ) = ( ( AMAX 23-AMI N2 3 ) *NP  ( 1 1 , 2 , 3 ) +AMI N2 3* nV-AMAX23 ) / 


A4P(I1,2,4)=( (AMAX24-AMIN24)*NP (11,2,4) +AHIN24*ITV-AMAX24)/ 
+(ITV-1.) 

ANP  ( 1 1 , 3 , 1 ) = ( (AMAX 31-AMl  N3 1 ) »NP  ( 1 1 , 3 , 1) +AMI N3  inTV-AMAX3 1)  / 
+ (1^-1.) 

ANP  (1 1 , 3 , 2)  = ( (AMAX32-AMIN32' *NP  ( II  ,3 , 2) +AMIN32*I'rV-AMAX32)  / 

+ (nv-i.) 

ANP(I1,3,3)=( (AMfO(33-AMIN33)*NP(Il,3,3)+AMIN33*ITV-AMAX33)/ 
+(ITV-1.) 

ANP(Il,3,4)*(  (AMAX34-AMIN34)*NP(H,3,4)+AMIN34*HV-AMAX34)/ 

+ (nv-i.) 

GOTO  (101,102,103,104,105) ,12 
101  IF(NP(Il,l,2) .EQ.l)  GO  TO  76 
GO  TO  106 
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102  IF(NP(Il,2,3).K3-l)  C»  TO  76 
GO  TO  106 

103  IF(NP(Il,3,2) .BQ.l)  GO  TO  76 
GO  TO  106 

104  IF(NP(Il,4.l>.Bn,l)  GO  TO  76 
GO  TO  ■'  * 

105  IF(^;?;11,5,1).E!Q.1)  go  to  76 
r;-'  TO  106 

76  DO  77  K«=l,4 

77  ANP(I1,I2,K)«0. 

106  IF(Il-IQ)  80,80,75 

75  WRITE(6,110)  Il,LCOST(Il) 

80  WRITE(6,120)  I2,TEGT(I2) , (ANP(Il,T2,K) ,K-1, 4) ,80081(11,12) 

90  IQ=I1 

WRITE (6,130)  F(X)ST 

100  PORMATCl' ,28X, 'T  EST  OESCRIPTIO  N'/ 

+3 9X, 'PARAMETER  VALUE ' /lOX , 'TEST  SEQUENCE' ,5X, "WPE' ,2X, 

+ 'NO.  l',2X,'NO.  2',2X,'NO.  3',2X,*NO.  4* ,2X,  "lOrAL  CCST'/ 

+7X,66 ('_•)//) 

110  POfWATC  8X,' LEVEL',  2X, 'NO.  ' ,I2,39X,F12.2) 

120  FORMAT {'  ' ,12X, 'TEST  tO.  ' ,I2,3X,A4.1X,4F7.2,Fl2.2) 

130  FORMAT ('  ' ,7X,66('_')//'  ' ,8X, 'TOTAL* ,’  GOST* ,43X,Fl2. 2//'  *, 
+61X,12('  ')/'  •,61X,12('_')) 

WRITe(6,T40)  TSMAX 

140  PORFftTC  ',8X,'TCrAL  SEQUENCE  TEST  STREfXJTH*' ,P8 .6) 

DEBUG  SUBCHK 

RETTURN 

END 

SUBROUTINE  DATA  (NCYC,M,P06P,CRECO,B,I1V,N,ADEP, 

+P  ,F,  R1  ,R2  ,CRl  ,CR2 , FRF  ,FRM  ,LEVEL,mP, 

+AMAX11 ,AMINll ,AMAX12 ,AM1N12 ,AMAX21 ,AMIN21 ,AMAX22 ,A.MIN22,AMAX23 , 
+AMI N2  3 , AMAX  2 4 , AMI  N 2 4 , AMAX  3 1 , AMI  N3 1 , AMAX  3 ? . A MT  V 3 7 , \MAX  3 3 , AMI  N 3 3 , 
+AMAX 34  , ’‘'3'! , , Ai-U iM**! , AMAX51  ,AMIN5i, AMAX52  ,AMIN52) 
DIMENSION  N(5) ,ADEF(5) ,P(11,4,5) , 

+F(11,4,5) ,Rl(ll,4,5) ,R2{11,4,5) ,CRl(5,5) ,CR2(5,5) 

R£AD(4,*)  ncyc,m,npafts,creqo,e,itv,frf,frm 

READ(4,*,END=2)  PDEF 
IF(PDEF)  2,2,1 

2 PDEF=0.01*NPARTS 
G’  TO  3 

1 PDEF=PDEF*NPARTS 

3 CO  5 I»1,M 
REA0{4,*,END'=4)  ADEFd) 

IF(ADEF(1))  4,4,5 

4 ADEF(I)-(7,/(3.*M))*?DEF 
GO  TO  7 

5 ADEF{1)*=ADLF(I)  *NPARTS 
7 WRITE (6, 98) 

WRITE (6,90)  NCYC,M, PDEF, CREQD,E,ITV, FRF, FRM 
WRITE (6, 99) 

WRITE(d,91)  (I,N(I) ,ADEF(I) ,I=1,M) 

DO  30  Il--‘1,M 
DO  30  I2=»l,5 


00005190 

00005200 

00005210 

00005220 

00005230 

00005240 

00005250 

00005260 

00005270 

00005200 

00005290 

00005300 

00005310 

00005320 

00005330 

00005340 

00005350 

00005360 

00005370 

00005380 

00005390 

00005400 

00005410 

00005420 

00005430 

00005440 

00005450 

00005460 

00005470 

00005480 

00005490 

00005500 

00005510 

00006520 

00005530 

00005540 

00005550 

00005560 

00005570 

0G005580 

00005590 

00005600 

00005610 

00005620 

00005630 

C0005640 

00005650 

00005660 

00005670 

G00Q5680 

00005690 

00005700 

00005710 


05 


READ{11,*,END=10)  P(1,I1,T2) 

IF  <P(1,I],12))  10,10,20 

10  DO  15  I=1,NCYC 
15  P(I.Il,l2)-.75 
GO  TO  30 

20  DO  25  I»l,NOrc 
25  P(I,Il.l2)-=P(l,Ii,I2) 

30  CONTINUE 
WRITE (6,92) 

WRITE(6,*)  ((P(i,J,K) ,K=1,5) ,J-1,M) 

DO  40  a1=!1,M 
DO  40  12=^1, 5 

READ(a ,*,END=45)  F(l,Il,l2) 

IF  (F(1,11,I2))  45,45,47 

45  DO  4b  I=1,NCYC 
F(I,1,I2)=1.0 
F(I,2,I2)=0.23 
F(I,3,I2)=0.43 

46  F(I,4,I2)=0.65 
GO  TO  40 

47  DO  48  I=1,NCYC 

48  F(I,Il,I2)=F(l,Il,I2) 

40  CONTINUE 

WRITE (6,93) 

WRITE(6,*)  ((F(1,J,K) ,K=1,5) ,J=1,M) 

DO  80  11=1, M 
DO  80  12=1,5 

RF]AD(9, " ,ENlJ=55)  Rl(l,Ii,l2)  ,R2(1,I1,I2) 
IF  (R1(1,I1,I2) ) 55,55,60 

55  DO  56  I=1,NCYC 

56  Rl(I  I1,I2}=0,5 
GO  TO  61 

60  DO  57  I=1,NCYC 

57  Rl(I,Il,l2)=Rl(l,ll,I2) 

61  IF  (R2(1,I1,I2) ) 65,65,70 

65  DO  66  I=1,NCYC 

66  R2(I,I1,:2)=0.5 
GO  TO  80 

70  DO  62  I=1,NCYC 

67  R2{l,Il,I2)=R2(l,Ii,I2) 

80  CONTINUE 

WRITE(6,94) 

WRITE (6,*)  ((Rl(l,J,K) ,K=1,5) ,J=1,M) 
WRITE(5,95) 

WRITE{6,*)  ((R2(1,J,K) ,K=1,5) ,J=1,M) 

DO  300  11=1, M 
DO  300  12=1,5 
READ(4,*,END=100)  B2,B3 
IF  (B2)  100,100,105 

100  GO  TO  (101,102,103,104) ,11 

101  CH1{1,I2)=9.5 
GO  TO  150 

102  CR] (2,I2)=9.46 


00005720 

00005730 

00005/40 
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00005810 
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00005860 

00005870 

00005880 

00005390 

00005900 

00005910 

00005920 

00005930 

00005940 

00005950 

00005960 

00005970 

00.005980 

00006000 

00006010 

00006020 

00006030 

00006040 

00006050 

00006060 

00006070 

00006080 

00006090 

00006100 

00006110 

00006120 

00006130 

00006140 

00006150 

0000616G 

00006170 

00006180 

00006190 

00006200 

00006210 

00006220 

00006230 

00006240 
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GO  'lO  150 

00006250 

103  CR1(3,I2)*51.5 

00006260 

GO  TO  150 

00006270 

104  CRl(4,l2)-63,0 

00006280 

GO  TO  150 

00006290 

105  CR1(I1,I2)-B2 

O0CO6300 

150  IF  (B3)  200,200,110 

00006310 

200  GO  TO  (201,202,203,204) ,Tl 

00006320 

201  CR2 (1,12) *0.1 

00006330 

GO  TO  300 

00006340 

202  CR2(2,I2)»3.67 

00006350 

GO  TO  300 

00006360 

203  CR2(3,I2)=45.5 

00006370 

GO  TO  300 

00006380 

204  CR2(4,I2)*57.0 

00006390 

GO  TO  300 

00006400 

110  CR2(I1,I2)*B3 

00006410 

300  COOTINUE 

00006420 

WRITE (6,96) 

00006430 

WRITE(6,*)  ({CR1(J,K) ,K=1,5) ,J=1,M) 

00006440 

WRITE (6,97) 

00006450 

WRITE(6,*)  ((CR2(J,K) ,K*1,5) ,J*1,M) 

00006460 

DO  89  1=1,NCYC 

00006470 

DO  89  J=1,M 

00006460 

NJ*N(J) 

00006490 

DO  89  K=1,NJ 

00006500 

F(I,J,K)=F(1,J,K) 

000065X0 

Rl(I,J,K)=Rl(l,J,K) 

00006520 

89  R2(I,J,K)=R2(1,J,K) 

00006530 

; TEST  ONE:  CONSTANT  TEMPERATURE 

00006540 

READ(12,*)  AMAXil,AMINll 

00006550 

IF(AMAX11.NE.0. .OR.AMINll.NE.O.)  GOTO 

1001 

00006560 

AMAX11*70. 

00006570 

AMINll=-55. 

C0006580 

1001  READ(12,*)  AMAX12.AMIN12 

00006590 

IF(AMAX12.NE.0, .OR.AMIN12.NL.O.)  GOTO 

1002 

00006600 

AMAX12=170. 

00006610 

AMINl2==0. 

00006620 

1002  CONTINUE 

00006630 

: TEST  TV-O:  CVfCr.ED  TEMPERATURE 

00006640 

READ(12,*)  AMAX21,AMIN2i 

00006650 

2F(AMAX21.NE.0. .OR,AHrN21.NB.O.)  GO  TO 

2001 

00006660 

AMAX21=70. 

00006670 

AMIN21=25. 

00006680 

2001  READ(12,*)  AMAX22,AMIN22 

00006690 

1F(AMAX22.NE.0. .OR.AMIN22.NE.0.)  GO  TO 

2002 

00006700 

AMAX22^~50. 

00006710 

AMIN22«=-25. 

00006720 

2002  READ(12,*)  AMAX23 ,AMIN23 

00006730 

IF(AMAX23.NC.O. .OR,AMIN23.NE.O.)  GO  TO 

2003 

00006740 

AMAX23=10. 

00006750 

AMIN23=0. 

00006760 

2003  READ (12,*)  AMAX24 ,AM7N24 

00006770 

Ignunnggl^gill 
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IF(AMM24.NE,0.  .OR.AMI1S124.1VS.0.)  GOTO  2004  00006780 

AMAX24=64.  00006790 

AMIN24=10.,  00006800 

2004  CONTINUE  00006810 

C TEST  THREE;  VIBE^ATION  00006820 

READil2,*)  AMAX31,AMIN31  00006830 

IF(AmX31.NE.O.  .OR.AMIN31.NE.O.)  GO  TO  3001  00006840 

AMAX31"6.  00006850 

AMIN31=1.  00006860 

3001  READ(12,*)  AMAX32,AMIN32  00006870 

1F(AMAX32.NE.0. .OR.AMIN32,NE.0.)  GO  TO  3002  00006880 

AMAX32=2.  00006890 

AMIN32=0.  00006900 

3002  READ(12,*)  AMAX33 ,AMIN33  00006910 

IF(AMAX33.NE.O..OR.AMIN33.NE.O.)  GOTO  3003  00006920 

AMAX33=25.  00006930 

ANIN33=25.  00006940 

3003  REAO(12,*)  AMAX34,AMIN34  00006950 

IF(AMAX34.NE.O..OR.AMIN34.NE.O.)  GO  TO  3004  00006960 

AMAX34=64.  00006970 

AMIN34=10,  00006980 

3004  CONTINUE  00006990 

C TEST  POUR:  CONST'.^NT  POWER  00007000 

READ(12,*)  AMAX41,AMIN41  00007010 

IF(AMAX41.NE,0. .OR.AM1N41.NE.O.)  GO  TO  4001  00007020 

AMAX4 1=168.  00007030 

AHIN41=0.  00007040 

4001  CONTINUE  00007050 

C TEST  FIVE:  CYCLEO  POWER  00007060 

READ(12,*)  AMAX51,AMXN51  00007070 

IF(AMAX51.NE.0. .OR.AMIN51.NE.O.)  GO  TO  5001  00007080 

AMAX51=8.  00007090 

AMINS 1=0.  00007100 

5001  READ(12,*)  A1'1AX52,AMIN52  00007110 

IF'(AI4AX52.NE.O.  .OR.AMIN52.NE,0,)  GO  TO  5002  00007120 

AMAX52=168.  00007130 

AMIN52=3.  00007140 

5002  CONTINUE  00007150 

98  FORi'V'.T  Cl ' ,28X,' TABLE  A - PROGRAM  DATA'/’  ',80  00007160 

+4X, 'NCYC ,11X, 'M' ,6X, ' (PDEF.NPARTS) ' ,4X, 'CRBQD' ,10X,  00007170 

+ '£ ’ ,ilX C ITV ' ,10X, ' FRF ' ,10X, ' FRM'/’  OCOG7180 

+130 ('-')//)  00007190 

99  FORMAT! '1' ,24X, 'TABLE  B - TEST  AND  ASSEMBLY  DATA'/'  ',80('_')/'  ',00007200 

+4X,  'ASSEMBLY  LEVEL'  ,2X,  'InIUMBER  OF  SCREENS'  ,2X,  00007210 

+'EXPECT’EO  number  OF  ASSEMBLY  DEFECTS'/'  ' ,4X, 14 2X, 17 2X00007220 
+,35{ '_')//)  00007230 

90  FORMAT!'  ' ,5X,I2,12X,I1,6X,F13.0,F13.2,5X,F8.6,5X,I3,5X,2F13,2)  00007240 

91  FORMAT!'  ' ,7X,I2,14X,I2,22X,F9.0)  00007250 

92  FORMAT { '1 ' ,14X,' TABLE  C - DETECTION  PROBABILITIES  FOR  TEST',  00007260 

+ ' FOUIPMEOT'/'  ',80! ’_')//)  00007270 

93  FORMAT ('1 ■ ,4X,' TABLE  D - FRACTION  OF  DEFECTS  REQUIRING  ’,  00007280 

+ 'PRIMAi^Y  LEVEL  !CARD  ASSY)  FEVORK'/'  ',80! '_')//)  00007290 

94  FORMAT!'!' ,20X,' TABLE  E-FHAaTON  OF  DEFECTS  REMOVED  AT'/'  ',  00007300 


+19X,'THE  PRIMARY  LEVEL  PER  REVDRK/RETEST  CYCLE'  00007310 

+/'  ',80( '_')//)  00007320 

95  FORMAT (' 1' ,14X, 'TABLE  F - FRACTION  OF  DEFECTS  REMOVED  AT  00007330 

+'THE  HIGHER'/'  ' ,20X , 'ASSEMBLY  LEVEL  PER  REWORK/',  00007340 

+' RETEST  CYCLE'/'  ',80('_')//)  00007350 

96  FORMATCl' ,18X, 'TABLE  G - PRIMARY  LEVEL  REWORK  COST  PER',  00007360 

+'  CYCLE'/'  ',80 ('_')//)  00007370 

97  FORMATCl' ,13X,' TABLE  H - HIGHER  ASSEMBLY  LEVEL  REWORK  ',  00007380 

+ 'COST  PER  CYCLE'/'  ',80C_')//)  00007390 

RETURN  00007400 

END  00007410 
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